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A METHODOLOGY  FOR  STUDYING  THE  DYNAMICS 
OF  EXTENDED  LOGISTIC  SYSTEMS* 

Stephen  C.  Gravest  and  Julian  Keilson 


Graduate  School  of  Management 
The  University  of  Rochester 
Rochester , New  fork 

ABSTRACT 

An  extended  logistic  system  is  a well-defined  configuration  of  equipment, 
modules,  inventories,  and  repair  and  replacement  facilities  modeling  a complex, 
repairable  system  with  on-going  repair.  The  design  of  such  systems  has  been 
based  largely  on  the  static  tools  of  inventory  theory  and  reliability  theory,  i.e., 
on  steady-state  distributions  and  on  associated  means  and  variances.  Such 
static  tools  suppress  the  scale  of  real  time  and  ignore  system  persistence  time  in 
up-states  and  persistence  time  in  down-states. 

A reasonably  simple  dynamic  methodology  is  presented,  focusing  on  system 
failure  time  as  a more  meaningful  objective  function  for  system-design  trade- 
off studies.  In  the  presence  of  good  reliability,  it  is  shown  that  different  candi- 
dates for  system  failure  time  effectively  merge  to  yield  an  unambiguous,  single 
system  failure  lime.  Examples  illustrating  the  importance  or  dynamic  informa- 
tion for  system  design  are  given. 

INTRODUCTION 


The  design  of  complex,  repairable  systems  has  been  based  largely  on  static  tools  of  inven- 
tory theory  and  reliability  theory,  i.e.,  on  steady-state  distributions  and  on  associated  mean 
values  and  variances.  Such  static  tools  neglect  real  time,  a crucial  dimension  for  the  description 
of  system  behavior.  Specifically,  the  persistence  times  of  both  satisfactory  and  unsatisfactory 
system  performance  are  unavailable  in  static  studies.  Information  on  these  persistence  times  is 
vital  to  an  understanding  of  the  dynamic  behavior  of  the  system,  and  hence  it  is  vital  to  the 
evaluation  of  system  performance.  A dynamic  treatment  of  system  behavior  quantifier  such 
persistence  times,  and  permits  the  study  of  the  influence  of  system-design  trade-offs  on  their 
frequency  and  duration.  The  purpose  of  this  paper  is  to  propose  a methodology  for  the  analysis 
of  this  dynamic  behavior  and  to  give  a preliminary  indication  of  how  this  analysis  would  be 
incorporated  into  the  design  decisions  for  complex  systems. 

This  study  consists  of  five  parts.  In  Section  1 an  informal  study  of  the  state  of  the  art  in 
system  design  is  presented,  i.e.,  of  the  tools  of  inventory  theory  and  reliability  theory  currently 
employed.  Here  we  discuss  the  limitations  of  current  inventory  theory  and  reliability  theory  for 
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the  study  and  understanding  of  the  dynamic  behavior  of  complex  systems.  In  Section  II,  an 
alternative  approach  is  proposed  which  may  improve  system  understanding  and,  hence,  improve 
system  design.  This  model  is  an  outgrowth  of  ideas  developed  earlier  [1,21  for  the  study  of  sys- 
tem reliability.  In  Section  III,  the  model  is  illustrated  in  terms  of  a simple  single-item  system. 
Section  IV  demonstrates  how  these  single-item  inventory  techniques  combine  readily  for  the 
study  of  multi-item  systems.  In  Section  V,  a simple  example  is  presented  to  illustrate  the 
necessity  of  dynamic  information  for  making  system-design  decisions. 

This  document  is  presented  at  a reasonably  simple  mathematical  level  in  keeping  with 
practical  needs.  The  supporting  papers  underlying  the  methodology  [1-3]  are  more  mathemati- 
cally complete. 

I.  STATE-OF-THE-ART  ANALYSIS 

A.  Extended  Logistic  Systems 

An  extended  logistic  system  is  a well-defined  configuration  of  complex  equipment,  sup- 
porting inventory  levels  of  components  and  modules,  supporting  maintenance  facilities,  sup- 
porting transportation  system  between  local  and  remote  inventory  and  maintenance  sites,  and 
procedures  governing  the  allocation  and  shipment  of  components  from  remote  to  local  sites. 

For  systems  of  interest  to  this  study,  breakdown,  repair,  and  replacement  are  intrinsic  ele- 
ments, and  system  availability  depends  critically  on  component  reliability,  redundance  built  into 
the  equipment,  availability  of  repair  personnel,  levels  of  supporting  inventories,  and  the  delays 
associated  with  repair,  replacement,  and  transportation  from  remote  sites. 

Randomness  is  implicit  in  all  these  elements.  Specifically,  components  and  modules  are 
governed  by  failure-time  distributions.  Each  failure  type  has  an  associated  repair  or  replace- 
ment time  distribution,  and  pipeline  transportation  times  are  random.  Consequently,  inventory 
levels  fluctuate  and  system  availability  is  impaired  correspondingly. 

Examples  of  extended  logistic  systems  would  be  a squadron  of  aircraft,  a radar  system,  or 
a network  of  communication  satellites.  For  each  of  these  systems,  the  basic  unit  of  interest  (an 
aircraft,  a radar  unit,  or  a satellite)  is  a complex  combination  of  components  which  are  subject 
to  failure.  For  each  component  there  are  supporting  inventory  and/or  repair  facilities,  and 
specific  replacement  procedures  for  such  failures.  System  performance  is  evaluated  according  to 
system  availability  and  the  logistic  costs  required  to  obtain  that  level  of  availability. 

B.  Present  Theory  for  System  Design  and  Procurement 

System  design  and  procurement  has  relied  heavily  on  current  reliability  and  inventory 
theory.  In  this  section  we  will  briefly  characterize  the  available  tools  from  reliability  and  inven- 
tory theory  and  indicate  the  shortcomings  of  these  tools  for  understanding  the  dynamic 
behavior  of  complex  systems.  The  intent  here  is  not  to  provide  a comprehensive  review  of  the 
current  literature,  but  to  indicate  the  need  for  a dynamic  theory. 

Reliability  Theory 

Reliability  theory  addresses  itself  to  the  modeling  of  systems  subject  to  breakdown.  A 
given  reliability  model  may  be  classified  by  the  presence  or  absence  of  the  following  characteris- 
tics in  the  system  being  described: 
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(a)  Complexity:  A system  is  complex  if  there  are  many  modules  that  may  fail. 

(b)  Redundance:  A system  which  is  complex  has  redundance  when  one  or  more  modules 
may  fail  without  the  system  failing.  The  redundance  may  be  built  into  the  system  equipment  or 
may  be  present  in  the  form  of  standby  equipment  with  instant  replacement.  For  a redundant 
system,  the  functioning  or  nonfunctioning  of  the  system  is  specified  by  a system  structure  func- 
tion telling  for  which  subsets  of  working  modules  the  system  works. 

(c)  Activity:  A system  model  may  be  called  active  when  modules  which  break  down 
undergo  repair  or  replacement.  Up  periods  and  down  periods  for  the  system  then  alternate.  A 
system  model  that  is  not  active  may  be  called  passive;  consequently,  passive  systems  are  con- 
cerned solely  with  the  time  until  the  first  system  failure. 

(d)  Dynamics:  The  system  model  may  be  called  dynamic  when  it  is  concerned  with  the 
transient  behavior  of  the  system,  e.g.,  with  the  distribution  of  up  times  and  down  times  for  the 
system,  and  the  correlation  between  these.  When  only  steady-state  information  is  given,  e.g., 
the  steady-state  probability  that  the  system  is  up  (system  availability),  the  model  may  be  called 
static. 

For  most  of  the  literature  of  reliability  theory,  one  or  more  of  these  model  characteristics 
are  absent.  Often  treated  are  models  in  which  the  failure-time  distribution  or  mean  failure  time 
of  the  system  is  inferred  from  that  of  the  components  in  the  absence  of  repair,  i.e.,  passive 
models.  Other  reliability  models  which  are  active  deal  with  systems  whose  level  of  complexity 
or  redundance  is  modest,  with  only  a few  modules  present  or  with  very  simple  series  or  parallel 
structure.  Those  few  models  which  are  complex,  redundant,  and  active  are  static  and  somewhat 
narrow  in  their  applicability.  The  level  of  complexity  present  in  these  is  far  removed  from  most 
complex  systems  of  interest,  e.g.,  radar  stations,  or  aircraft  squadrons. 

Inventory  Theory 

Inventory  model  studies  are  intrinsically  redundant  and  active  (drawing  continuous 
replacement)  in  the  sense  above.  Model  characteristics  appropriate  to  inventory  models  are: 

(a)  Multi— item  : Here  the  concern  is  with  stockage  of  a set  of  modules  or  items,  as 
against  single-item  studies  where  there  may  or  may  not  be  dependence  across  items. 

(b)  Multi— echelon  : Such,  studies  are  concerned  for  example,  with  forward  inventories, 
regional  inventories,  and  central  inventories  and  their  interaction,  i.e.,  the  relation  between  the 
delays  and  shortages  at  the  different  echelons. 

(c)  Dynamic : Again  models  are  dynamic  when  they  are  concerned  with  the  distribution 
of  persistence  times  for  shortages,  distributions  of  times  to  depletion,  etc.  Studies  concerned 
only  with  steady-state  (ergodic)  stockage  levels,  their  distributions,  expectation,  variance,  etc., 
may  be  called  static. 

The  studies  in  the  OR  literature  are  largely  single-item  studies,  with  one  echelon.  The 
multi-echelon  studies  are  single-item  and  static.  The  multi-item  case  can  be  treated  if  the 
different  items  behave  independently  and  if  only  steady-state  distributions  are  wanted. 

For  complex  equipment  to  function,  all  modules  must  be  functioning.  Even  though  the 
inventory  levels  of  different  modules  are  effectively  independent  or  may  be  treated  as  indepen- 
dent, and  the  joint  distribution  of  module  levels  is  the  product  of  the  individual  distributions  of 
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levels,  of  crucial  concern  to  system  availability  is  the  availability  of  complete  sets  of  individual 
modules.  The  stockage  levels  of  individual  components  and  modules  interact  through  this 
requirement,  and  the  dynamics  of  system  availability  is  much  harder  than  the  statics. 

For  system  design  and  procurement,  the  models  needed  are  multi-item,  multi-echelon 
and  dynamic.  Such  models  have  not  been  available.  In  particular,  the  dynamic  behavior  of 
multi-item,  multi-echelon  systems  has  not  been  dealt  with  in  logistics  studies,  and  understand- 
ing, qualitative  or  quantitative,  of  fluctuation  in  system  availability  is  poor.  The  only  available 
tool  for  studying  the  dynamics  of  complex  systems  has  been  very  detailed  simulations,  which 
can  provide  the  system  behavior  for  a specific  system  configuration,  but  which  give  little  insight 
into  an  overall  understanding  of  system  behavior.  The  significance  of  this  gap  in  system  under- 
standing will  be  discussed  next. 

C.  The  Study  of  System  Trade-offs 

The  design  of  an  extended  logistic  system  consists  logically  of: 

(a)  Prediction  of  system  performance  and  reliability  characteristics  attendant  to  a choice 
of  system  design  parameters,  i.e.,  component  and/or  module  parameters;  stockage  levels  at 
field  and  depot  sites;  personnel  support  levels;  pipeline  parameters; 

(b)  Determination  of  'feasible*  system  parameter  choices  described  in  (a)  assuring 
minimally  acceptable  performance  and  reliability  characteristics; 

(c)  Evaluation  of  net  present  value  of  total  system  cost  obtained  by  adding  the  cost  of 
initial  procurement  to  inventory,  repair,  and  pipeline  operations  cost  (discounted)  over  the 
planned  life  of  the  system; 

(d)  Selection  of  that  feasible  system  with  minimal  total  system  cost. 

Such  an  extended  logistic  system-design  procedure  viewed  as  an  optimization  problem  is 
enormously  ambitious  for  complex  systems,  and  full  achievement  is  correspondingly  unrealistic. 
Difficulties  surrounding  the  problem  of  predicting  system  performance  from  its  parameters  and 
gaps  in  OR  techniques  for  such  prediction  have  been  described  in  Section  IB  above.  The 
optimization  phase  of  the  design  — evaluation  of  total  cost  and  selection  of  a minimal  cost  sys- 
tem — may  only  be  possible  crudely  by  examining  cost  changes  associated  with  system-design 
trade-offs. 

Such  trade-off  examinations  are  clearly  impossible  except  within  the  framework  of  an 
overall  system  study,  in  which  phases  (a),  (b),  (c),  and  (d)  are  pursued  as  parts  of  a well- 
defined  organic  whole.  The  absence  of  any  unified  theory  of  extended  logistic  systems  hampers 
such  trade-off  examinations  by  system  designers  on  any  meaningful,  systematic  basis.  System 
design  as  now  practiced  is  correspondingly  makeshift  and  appears  to  be  more  of  an  engineering 
art  than  an  engineering  discipline. 

Trade-offs  of  interest  are  component  quality  vs  redundancy  inside  equipment  vs  stockage 
levels,  field  stockage  levels  vs  central  stockage  levels,  quality  in  one  type  of  system  component 
or  module  vs  that  in  another  type,  and  inventory  levels  of  one  item  vs  those  of  another.  There 
is  need  to  refine  the  intuitive  notion  of  a "balanced"  system  (i.e.,  a system  in  which  a change  in 
investment  represented  in  any  two  system  levels  meeting  system  needs  raises  system  costs)  and 
to  develop  simple  rules  permitting  quick  recognition  of  system  imbalance. 
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D.  The  Importance  of  Understanding  Dynamic  System  Behavior 

Consider  a single-item,  single-echelon  inventory,  that  of  aircraft  engines,  say.  The  inven- 
tory level  n(t)  fluctuates  in  time.  A sample  history  of  such  a fluctuating  level  might  have  the 
appearance  shown  in  Figure  1. 


n(t) 


Figure  1. 


A static  description  of  the  item  availability  might  take  any  of  the  following  forms: 

(1)  n : the  steady-state  average  number  of  items  available. 

(2)  Pgood  '■  the  probability  that  the  fluctuating  level  exceeds  a specified  critical  level  Nc 
regarded  as  being  satisfactory.  That  is,  for  n(t)  > Nc  the  system  is  said  to  be  in  the  "good" 
state  and  is  functioning,  while  for  n(t ) < Nc  the  system  is  in  the  "bad"  state  or  has  failed. 
pgood  is  the  "availability"  of  the  item. 

(3)  pr : the  steady-state  probability  that  r items  are  available  at  some  time  chosen  at  ran- 
dom. 

The  sequence  of  numbers  pr,  r — 0,  1,  2,  ....  is  the  steady-state  probability  distribution 
of  the  inventory  level.  From  this  distribution  one  may  calculate  all  static  information,  such  as 
the  availability  P GOOD,  the  average  n,  or  the  variance  <r*  of  the  distribution. 

Of  competing  interest  for  such  a fluctuating  level  nU ) is  the  persistence  time  TGOOD  of 
levels  above  the  critical  level  Nc  and  TBAD  for  levels  below  Nc.  One  might  wish  to  know  the 
average  of  TGOOD,  say,  or  its  variance,  or  the  probability  that  TBad  exceeds  three  days.  Ideally, 
one  would  like  the  distribution  of  the  good  and  bad  times,  but  expectations  and  variances  might 
suffice.  Such  dynamic  information,  however,  is  totally  unavailable  from  the  static  information 
contained  in  the  steady-state  distribution  Pr,  and  certainly  not  from  any  static  descriptive  such 
as  n or  PGOod  obtained  from  it.  Indeed,  the  steady-state  probabilities  entirely  suppress  any 
time-scale  parameter  of  interest.  The  availability  PGOOD  is  a duty  cycle  parameter  describing  the 
ratio  of  good  times  to  bad  times,  but  it  says  nothing  about  whether  there  is  fluctuation  from 
GOOD  to  BAD  once  a day  or  once  a year. 

A fluctuation  phenomenon  of  interest  for  system  availability  is  jitter,  the  rapid  fluctuation 
from  good  to  bad  levels  when  one  is  near  the  critical  level.  The  character  of  such  level  jitter  is 
again  unavailable  from  the  static  information. 

For  multi-item,  multi-echelon  systems,  the  limitations  of  static  answers  are  magnified. 
The  higher  dimension  of  the  multi-item,  multi-echelon  process  makes  the  system  behavior 
more  intricate  and  harder  to  visualize.  The  failure  time  of  the  system  is  the  central  random 
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variable  describing  the  behavior  of  interest,  and  this  cannot  be  obtained  from  steady-state  infor- 
mation. (The  concept  of  system  failure  time  for  complex,  redundant,  repairable  systems  is 
ambiguous.  Three  candidates  of  operational  interest  are  described  in  Section  II.) 

E.  A Possible  Theoretical  Framework  for  System  Design 

A theoretical  model  has  been  described  in  111.  The  methodology  supporting  the  model  is 
contained  in  12].  The  model  addresses  itself  to  the  behavior  of  complex,  redundant,  repairable 
systems  and  describes  procedures  for  calculating  certain  system  failure-time  distributions 
natural  to  the  description  of  the  reliability  of  such  systems.  The  model  has  the  following 
features: 

(a)  It  is  active  and  dynamic  in  the  sense  of  Section  IB. 

(b)  It  is  sufficiently  flexible  to  accommodate  multi-item,  multi-echelon  inventory  systems 
present  in  the  extended  logistic  systems  of  interest. 

(c)  The  model  describes  the  distribution  of  persistence  times  in  acceptable  (good)  and 
unacceptable  (bad)  system  states.  Two  related  system  failure  times  of  operational  interest,  the 
"ergodic  exit  time"  and  "quasi-stationary  exit  time"  are  described  and  related  to  the  persistence 
time.  The  three  failure  times  describe,  respectively,  the  duration  of  working  times,  the  time 
remaining  to  failure  when  the  system  is  working  routinely,  and  the  time  remaining  for  veteran 
systems  known  to  have  been  healthy  for  a very  long  time. 

(d)  Expected  system  failure  times  are  available  explicitly  in  terms  of  underlying  parame- 
ters in  the  presence  of  item  independence  or  time-reversibility,  permitting  calculation  of 
steady-state  probabilities  of  the  system  states. 

II.  SYSTEM  FAILURE  TIMES  FOR  COMPLEX,  REDUNDANT, 

REPAIRABLE  SYSTEMS 

A.  Definition  of  System  Failure  Times 

Consider  a complex,  redundant,  repairable  (active)  system  as  described  in  Section  IA.  It 
is  assumed  that  the  laws  governing  the  system  (e.g.,  failure  rates,  repair  rates)  do  not  change  in 
time.  Suppose  the  system  can  be  either  in  an  acceptable  state  (good  state)  or  an  unacceptable 
state  (bad  state).  For  example,  in  a single-item  inventory*  system  with  NO)  being  the  number 
of  failed  items  waiting  to  be  repaired  or  replaced  at  time  t,  the  system  may  be  in  an  acceptable 
state  if  NO)  < Wc  — a specified  critical  level,  while  if  NO)  > Nc  the  system  is  in  an  unac- 
ceptable state.  In  such  systems,  we  are  interested  in  the  behavior  of  the  persistence  time  for 
the  system  in  the  acceptable  region  and  in  the  unacceptable  region.  To  study  this  behavior,  we 
define  system  failure  to  occur  when  the  system  moves  from  an  acceptable  state  to  an  unaccept- 
able state.  System  failure  time  is  the  persistence  time  of  the  system  in  the  acceptable  region, 
i.e.,  the  time  until  the  sytem  fails  by  going  to  an  unacceptable  state.  For  complex  fluctuating 
systems,  we  need  to  find  the  system  failure-time  distribution  to  capture  the  dynamic  behavior 
of  the  system. 

For  general  systems,  a sensible  choice  of  (definition  of)  failure  time  is  not  obvious.  For 
this  study  we  will  consider  the  following  four  specific  system  failure  times  whose  simplicity  of 
structure  is  in  keeping  with  their  natural  intuitive  simplicity: 

•In  a field  selling  ihe  invenlory  level  might  be  ihe  availability  level,  i.e.,  ihe  number  or  parts  in  service  plus  working 
spares. 
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Failure  Time  from  the  Perfect  State:  Assume  thal  the  system  is  in  its  best  possible  state:  all 
components  in  the  system  are  new  and  working,  and  the  component  inventory  is  fully  stocked. 
The  time  until  the  system  first  reaches  an  unacceptable  state  (system  failure)  is  called  the 
"failure  time  from  the  perfect  state." 


Post-Recovery  Failure  Time:  Suppose  the  system  has  just  recovered,  i.e.,  the  system  has 
been  in  an  unacceptable  state,  and  has  just  now  made  a transition  to  an  acceptable  state.  The 
time  until  the  system  returns  to  an  unacceptable  state  (system  failure)  is  the  "post-recovery 
failure  time."  This  is  also  referred  to  as  the  "sojourn  time"  on  the  acceptable  region,  since  it 
represents  the  time  duration  in  the  acceptable  region  between  successive  visits  to  the  unaccept- 
able region. 


Ergodic  Failure  Time:  Suppose  that  the  system  has  had  a long  history  (i.e.,  the  system  is  in 
steady-state),  and  all  that  is  known  is  that  the  system  is  working  (the  system  is  in  an  acceptable 
state,  but  we  do  not  know  in  which  state  it  is).  We  have  no  other  knowledge  of  the  performance 
of  the  system  in  the  past.  The  time  until  the  system  stops  working  (system  failure)  is  the 
"ergodic  failure  time." 


Quasi-Stationary  Failure  Time:  It  is  known  that  the  system  is  currently  working  and  that 
for  as  long  as  anyone  can  remember  the  system  has  been  working.  Again,  we  do  not  know  in 
what  specific  working  state  the  system  is,  other  than  it  is  in  an  acceptable  state.  The  time  until 
the  system  reaches  an  unacceptable  state  (system  failure)  is  the  "quasi-stationary  failure  time." 
This  differs  from  the  ergodic  failure  time  in  that  for  the  ergodic  failure  time  the  possibility  of 
one  or  more  recent  system  failures  is  not  dismissed. 


In  a similar  manner,  four  analogous  system  recovery  times  could  be  defined,  where  we 
define  system  recovery  to  occur  when  the  system  moves  from  an  unacceptable  state  to  an 
acceptable  state. 


B.  Properties  of  System  Failure  Times 


The  properties  of  these  system  failure  times  and  their  relationships  are  presented  and  dis- 
cussed in  [1],  The  discussion  given  in  [1  ] is  based  on  the  theoretical  development  and  metho- 
dology contained  in  12).  As  employed  in  these  papers,  the  following  notation  will  be  used  to 
represent  the  four  system  failure  times: 


failure  time  from  the  perfect  state: 
post-recovery  failure  time; 
ergodic  failure  time; 
quasi-stationary  failure  time. 


We  will  assume  that  the  system  can  be  modeled  as  a stationary,  time-reversible  Markov 
chain  (see  12],  §1.3,  §2.4).  A stationary  chain  is  time  reversible  if,  for  all  values  of  f1(  t2,  m, 
and  n, 

PrlAf (/,)  - m,  N(tj)  - n)  - Pr[W(/,)  - n,  N(t£  - m), 

where  N(t)  is  the  state  of  the  system  at  time  t.  Time  reversibility  is  a common  property  for 
maujr  ' '--V'w  systems  and  is  discussed  in  greater  detail  in  (2).  In  particular,  the  system  con- 
sisting of  a collection  of  independent  components  with  exponentially  distributed  failure  times 
and  exponentially  distributed  repair  or  replacement  times  is  time  reversible. 
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Distributions  for  System  Failure  Times 

We  are  interested  in  the  probability  distributions  for  these  failure  times.  It  is  shown  in 
[21,  §6.6,  that  the  quasi-stationary  time  Tq  is  distributed  as  a pure  exponential.  That  is,  we 
have 

(1)  Sq  (r)  - probability  density  function  for  TQ 

— y exp  (-yr) 
and 

(2)  Fq  (r)  - survival  function  for  TQ 

— Problfp  > t]  - exp(— yr), 

where  fQ  — expected  value  of  Tq  ” 1/y. 

The  distributions  for  both  the  ergodic  failure  time  TE  and  the  post-recovery  exit  time  Tv 
are  mixtures  of  pure  exponential  distributions  (see  [2],  §6.9).  We  can  write  for  the  ergodic 


failure 

time 

(3) 

se(t)  - probability  density  function  for  TE 

- 'Lpe,  yj  e*P T> 

and 

(4) 

Fe(t)  — survival  function  for  TE 

- ProbfTf  >t)-£/ie  exp(-yy t), 

./ 

where 

pE  > 0 for  all  j,  y j > 0 for  all  j. 

Z Per  1. 

TE  - expected  value  of  TE  - (1  h)- 

i 

The  set  of  values  {y,}  is  common  to  all  four  failure  times,  and  y,  the  failure  rate  for  the 
quasi-stationary  time,  is  equal  to  min  (y7)  (see  (2)). 

Similarly,  we  have  for  the  post-recovery  failure  time 


(5) 

Mt)  “ HPy^i^Pi-yjr) 

and 

(6) 

Fyir)  - Y.Pvt  exp(— yy  t). 

where 

pv  > 0 for  all  j,  - 

TV  ” Z/V,  (l/V/)- 

The  terms  [pE]  and  [py^i  are  the  mixing  distributions  for  the  ergodic  failure  time  and  the 
post-recovery  failure  time,  respectively.  These  two  system  failure  times  differ  only  by  their 
mixing  distributions,  [pE]  and  [pyy 
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One  useful  property  of  a probabilitydistribution  that  is  a mixture  of  pure  exponential  dis- 
tributions is  that  the  survival  function,  F(t)  — Prob(7"  > r),  is  log-convex,  that  is,  G(t)  — 
log  [F(t)1  is  a convex  function  Note  that  in  the  case  where  F(r)  — exp(— yr),  the  survival 
function  is  both  log-convex  and  log-concave.  Thus  the  survival  functions  for  both  the  post- 
recovery  and  the  ergodic  failure  times  are  log-convex,  while  the  survival  function  for  the 
quasi-stationary  failure  time  is  both  log-convex  and  log-concave. 

The  distribution  for  the  failure  time  from  the  perfect  state  may  also  be  written  in  terms  of 
pure  exponential  distributions,  but  it  is  not  a mixture  of  exponential  distributions.  That  is,  we 
have 

(7)  sP(r)  - £ pp,  yj  txp(-yjr) 

j 

and 

(8)  F p(r ) - £ pp.  exp(-y,r), 

where  £p,  - 1, 

j 

TP-  5>,(<l/y,). 

j 

This  is  very  similar  to  the  expressions  for  the  ergodic  failure  time  and  the  post-recovery  failure 
time.  The  critical  distinction  is  that  here  pp  is  not  nonnegative  for  all  j\  hence,  [pn]  is  not  a 
mixing  distribution.  Thus  the  survival  function  for  the  failure  time  from  the  perfect  state  is 
not  log-convex.  Rather,  it  can  be  shown  that  the  survival  function  is  log-concave:  G(r)  — 
log  (F(t)]  is  a concave  function. 

In  the  context  of  reliability  theory,  we  can  add  a further  interpretation  for  notions  of  log- 
convexity  and  log-concavity  of  the  survival  functions  (see  [2],  §5.9).  A distriKution  with  a 
strictly  log-convex  survival  function  (e.g.,  TE  and  Tv)  has  a decreasing  failure  rate.  The  failure 
rate  or  likelihood  of  failure  in  any  instant  in  time  decreases  with  the  age  of  the  system;  the 
longer  the  system  operates  without  failure,  the  more  reliable  the  system  becomes.*  Conversely, 
a distribution  with  a strictly  log-concave  survival  function  (e.g.,  Tp)  has  an  increasing  failure 
rate.  Here  the  system  becomes  less  reliable  as  the  time  since  the  last  system  failure  increases. 

The  four  system  failure  times  are  related  by  the  following  inequalities  (see  [2],  §6.9): 

(9)  Fp(t)  > Fq(t)  > FE(r)  > Mr). 

Hence,  in  terms  of  system  survivaljabsence  of  failure),  it  is  better  to  start  in  the  perfect  state 
than  in  the  quasi-stationary  state  (F^r)  > F0(t)),  better  to  start  in  the  quasi-stationary  state 
than  in  the  ergodic  state  (F0(r)  ^ Ff(r)),  and  better  to  start  in  the  ergodic  state  than  in  the 
post-recovery  state  (,Fe(t)  > Mt)).  A direct  result  from  this  relationship  is  the  ordering  of 
the  expected  values  of  the  failure  times: 

(10)  ?„>  fQ>  Te7z  fy. 


'This  outwardly  paradoxical  behavior  must  be  understood  in  its  context.  The  failure  times  arc  for  systems  observed 
only  at  r - 0 and  the  subsequent  failure  time.  An  observed  random  system  is  continually  reconditioned  by  observa- 
tion. and  prediction  is  constantly  modified. 


1 
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C.  Limiting  Behavior  of  System  Failure  Times 

The  limiting  behavior  of  the  system  failure  times  as  system  reliability  increases  is  very 
informative.  It  is  shown  in  (2),  §8.4,  that  the  distributions  for  both  the  ergodic  failure  time  and 
the  failure  time  from  the  perfect  state  are  exponential  in  the  limit  as  system  reliability  is 
increased.  Examples  of  highly  reliable  systems  are  systems  for  which  the  failure  rates  for  the 
components  are  t .all  relative  to  the  components’  repair  or  replacement  rates  or  for  which  the 
inventory  of  space  components  is  large  relative  to  the  need  for  replacement  components.  In 
practice,  most  complex  systems  are  designed  to  be  highly  reliable,  due  to  the  heavy  penalties 
for  system  failure.  Furthermore,  the  convergence  to  exponentially  of  the  distributions  Fe(t) 
and  Fp(r)  is  quite  fast  for  increasing  system  reliability,  as  will  be  seen  in  the  next  section. 

The  limiting  behavior  of  the  post-recovery  failure  time  is  complicated  by  the  presence  of  . 

jitter.  Jitter  occurs  when  the  system,  having  just  recovered  from  being  in  the  unacceptable 
region,  has  a tendency  to  vacillate  between  the  acceptable  and  unacceptable  region  before 
embarking  upon  an  extended  sojourn  to  the  acceptable  region.  The  amount  of  jitter  in  a system 
will  vary  with  the  relative  magnitudes  of  the  failure  and  repair  rates  at  the  boundary  between 
the  acceptable  and  unacceptable  regions.  If  at  this  boundary  the  repair  rates  dominate  the 
failure  rates,  then  the  jitter  factor  will  be  small.  For  highly  reliable  systems,  we  would  expect 
this  to  be  the  case  and,  hence,  the  amount  of  jitter  to  be  small.  In  the  absence  of  jitter,  the 
distribution  of  the  post-recovery  failure  time  will  become  exponential  as  the  system  reliability 
increases. 

It  is  important  to  know  how  close  to  exponential  these  failure  times  ar-.?  A measure  for 
the  closeness  to  exponentiality  (in  the  class  of  mixtures  of  exponentials)  for  the  ergodic  failure 
time  and  for  the  post-recovery  failure  Ume  is  ( <r2/T 2)  - 1 (see  [21,  §8.7,  and  14]) , where  o-2  is 
the  variance  of  the  failure  time,  and  T is  the  expected  value  of  the  failure  time.  For  both  the 
ergodic  failure  time  and  the  post-recovery  failure  time,  this  measure  is  nonnegative;  the  closer 
the  measure  is  to  zero,  the  closer  the  distribution  is  to  being  an  exponential  distribution. 

We  have  defined  four  system  failure  times  that  are  of  interest  in  the  design  and  analysis 
of  complex,  redundant  repairable  systems.  We  have  stated  various  properties  for  the  distribu- 
tions of  these  failure  times,  and  have  shown  the  interrelationship  among  these  distributions. 

Of  particular  interest  is  the  fact  that  the  distributions  of  the  system  failure  times  for  highly  reli- 
able systems  are  exponential  or  nearly  exponential.  The  significance  of  this  observation  lies  in 
the  fact  that  the  exponential  distribution  is  completely  characterized  by  one  parameter,  the 
mean  value.  Hence,  for  reliable  systems,  given  only  the  means  for  the  system  failure  times,  we 
may  very  accurately  approximate  the  distributions  for  these  failure  times.  Furthermore,  the 
mean  values  for  the  system  failure  times,  particularly  for  the  post-recovery  failure  time,  are 
obtainable  (see  [2],  §6.7,  §6.8).  For  particular  systems,  such  as  a system  modeled  by  a birth- 
death  process,  these  mean  values  can  be  computed  from  analytical  expressions  or,  at  worst,  can 
be  found  by  means  of  simple  computer  programs.  Thus,  the  information  provided  by  these 
system  failure  times  can  be  easily  incorporated  into  the  design  and  analysis  of  reliable  systems. 

III.  ILLUSTRATION  OF  SYSTEM  FAILURE  TIME  BEHAVIOR 

In  this  section  we  consider  systems  which  can  be  modeled  as  birth-death  processes.  We 
indicate  how  the  system  failure-time  distributions  may  be  computed,  and  illustrate  these  distri- 
butions for  a set  of  specific  models. 
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A.  Birth-Death  Processes 


Consider  a single-item  inventory  system  which  may  to  modeled  as  a birth-death  process. 
The  system  at  time  t is  characterized  by  N (t)  — the  number  of  items  that  have  failed  and  are 
being  repaired  or  are  waiting  to  be  replaced.  The  state  variable  ranges  from  0 failed  items  (the 
perfect  state)  to  K failed  items,  where  K equals  the  maximum  possible  number  of  available 
items.  For  any  state  N(t)  - n , system  transitions  are  characterized  by  A„,  equal  to  the  transi- 
tion rate  from  n failed  items  to  n + 1 failed  items,  and  by  equal  to  the  transition  rate  from 
n failed  items  to  n — 1 failed  items.  That  is,  when  n items  are  not  working  (K  — n items  are 
available),  \n  is  the  failure  rate  and  is  the  repair  rate.  By  definition,  p0  - 0 and  kK  - 0. 
The  system  and  its  transitions  may  be  visualized  as  in  Figure  2,  where  the  boxes  represent  the 
states  of  the  system  and  the  dotted  arrows  are  the  potential  transitions.  For  these  systems,  the 
acceptable  region  is  specified  by  Nc , equal  to  the  critical  level;  the  system  is  in  an  acceptable 
state  if  N(t)  < Nc  and  is  in  an  unacceptable  state  if  N(t)  > Nc. 


ACCEPTABLE  REGION 


XL_ 

[l 

I j 


UNACCEPTABLE  REGION 


Figure  2. 

In  the  traditional  static  models,  attention  is  focused  on  the  steady-state  properties  for  the 
system.  For  the  birth-death  process,  the  steady-state  probabilities  are  easily  found  as  follows 
(see  [2],  §3.3): 

(11)  en  - steady-state  probability  of  system  being  in  state  n 
- Pr(/V(/  = oo)  _ n] 


'n’n  / £ trm, 

m— 0 


where 


(12)  7T  o-l 


(13)  rr„  - 77„_,  An_,  / nn  for  n - 1,  2,  . . . , K. 

B.  Computation  of  System  Failure-Time  Distribution* 

Let  s„+(t)  be  the  first-passage-time  density  from  state  n to  state  n + 1 for  the  process 
)V(r).  The  densities  for  the  system  failure  times  (except  for  s0)  can  be  stated  in  terms  of 
sf  (t)  as  follows: 

•The  methodology  in  this  section  was  introduced  in  [31  and  extends  earlier  calculations  of  Ross  and  Huisjes  15J. 
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(14) 

sp(r) 

- J0+*  i|+*  •••  *SNC 

(15) 

Sy(r) 

*"  SNC  (r)» 

and 

(16) 

Nc  Nc 

s£(r) 

- L er,sa(.r)  / £ 

n *0  n —0 

where 

(17) 

W 

- first  passage  time  i 

- *+•  Sn\  ,*  ...  Vc(t) 

and  * indicates  convolution. 


In  words,  the  failure  time  from  the  perfect  state  is  the  first  passage  time  from  the  perfect  state 
(0)  to  state  Nc  + 1 (the  first  state  reached  in  the  unacceptable  region).  The  post-recovery 
failure  time  is  the  first  passage  time  from  state  Nc  to  state  Nc  + 1.  The  ergodic  failure  time  is 
a weighted  combination  of  first  passage  times  from  state  n to  state  Nc  + 1.  where  the  weights 
are  the  ergodic  probabilities  of  being  in  state  n,  conditioned  on  the  system  being  in  the  accept- 
able region. 


If  the  process  is  in  state  n,  it  can  reach  state  n + 1 either  by  going  directly  to  n + 1 or  by 
first  backtracking  through  state  n - 1.  This  leads  to  the  following  relations  for  s„+(t): 

(is)  ,+  (T)  - x0<rx°r 

and 

(19)  s* (t)  - A„  e" ('‘«+X',T  + e~^k')T  V-i  (r)  V(r), 

for  n > 0. 


Taking  Laplace  transforms  of  (18)  and  (19),  we  obtain 
(20)  <r0+(s)  - Z.(s0+(t)1  - X° 


kn  + S 


and 

(21)  <r  +(s)  — L [s„+(r)] 


s + A„  + n„  - 
Differentiation  of  (20)  and  (21)  gives 


(22)  -J-  OT0+(j)  - - 

ds  (A„+s)2 


and 


(23)  -7-  <r+(s) ^ 

ds  [s+A„+(i,-^„<r„t|(j)]J 


By  induction  over  n,  we  get 


(24)  Ys  9 H*)  < °>  » - 0,  1,  2, 


for  all  s,  except  at  singularities.  Furthermore,  we  have,  also  by  induction 


(25)  lim  <r+(s)  - 0,  n — 0,  1,  2 

S—±°o 


'J 


i 
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where 


(37)  - X0 


(38)  0 < 9 ,,  < 0„,+l.  for  n - 1.2 (-1,2 n - 1, 

(39)  for  i»  — 1,  2 1-1,2 « — 1. 

Now  we  can  use  (32)  and  (36)  to  reexpress  (14)  as 


(40)  LWrll- 


X0Xi  . . . X/vr 
XoX,  ...  \N(. 

Nc  4-1 

n (s  + oN  + 1,) 

/-I  1 


/-I  s + fl/vc+ 1./  ’ 

where  is  the  residue  of  L (sP(r)]  at  the  pole  corresponding  to  s - —9 nc+\.i-  Inverting  (40), 
we  obtain 

vc+i 

41)  *p(t)  - Z Pp,  exp (~r9Nc+i  i). 

/ — 1 

Similarly,  for  the  post-recoverv  time,  we  have  from  (15) 

(42) 

Pnc+ i(s) 

Nc 

n (s  + 9N  ,) 

/-I 

" /Vc-M 

IT  (s+9N  + ! ;) 

/—I  L 


•i  s + 9 * 


Hence 


Mt)  - £ 0*  expl-Tfl^, ,), 


where  p yi  is  the  residue  at  the  pole  s — —0N  + 1 For  the  ergodic  failure  time,  we  have  from 
(16) 


(44)  L[s,(r)]-^ 


V 

Z ^ n ^ ff  ^ /i  + l X Pn(s) 


^+1(5)  Z 


&J  2* 


( 
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ftfr 

,_1  s+0/vc+l.l 


Hence 


sE(r)  - £ /3f,  exp(-T0vr+i.,). 


where  /3  f,  is  the  residue  at  the  pole  s “ ~9nc+i.i- 

Therefore,  to  compute  these  three  failure  time  distributions  we  need  to  find  the  zeros  of 
^nc+i(j)  and  the  three  sets  of  residues  from  the  “Laplace  transforms.  The  quantity  P„(s)  can 
be  computed  recursively  from  relations  (33),  (34),  and  (35).  At  each  stage  of  the  recursion, 
the  n zeros  of  P„(s)  can  be  found  by  direct  search.  Relations  (37),  (38),  and  (39)  can  be  used 
to  speed  up  this  search;  that  is,  adjacent  zeros  for  P„-i(s)  are  used  as  brackets  for  the  search  of 
the  zeros  of  P„(s).  To  find  the  set  of  residues,  we  need  the  Laplace  transform  of  the  failure- 
time density;  given  the  polynomials  P„(s),  these  transforms  are  easily  found  using  (40),  (42), 
or  (44).  The  residue  /9.,  is  found  by  evaluating  (s  + 0N(.+i ,)  LIs.(t)]  at  s = -0\r+i.,. 

The  quasi-stationary  failure  time  density  is  now  just  the  pure  exponential, 

(46)  sq(t)  - 0vr+l.,  exp(-T«/Vr+l  ,). 

C.  Graphs  Demonstrating  Failure  Time  Behavior 

We  consider  four  possible  systems.  For  each  system  we  assume  that  K — 10  and  Nc  - 5. 
That  is,  there  are  a maximum  of  ten  items  available,  and  at  least  five  of  these  items  are 
required  to  be  in  working  order  at  any  time.  If  six  or  more  items  have  failed  (less  than  five 
working),  the  system  is  in  an  unacceptable  state.  The  four  systems  are  specified  by  their  repair 
and  failure  rates  as  follows  ( X and  n are  constant  parameters) : 

A.  - X,  n„  - 

B.  A„  - (K  - n)X,  nn  - n; 

C.  A„  - X,  n„  - nfi\ 

D.  A„  - (K  - n) X,  n„  - nn. 


System  A assumes  that  the  repair  rate  (/i„)  is  independent  of  the  number  of  failed  items, 
and  the  failure  rate  (A„)  is  independent  of  the  number  of  working  items.  For  instance,  the 
repair  facility  may  be  able  to  work  on  only  one  item  at  a time,  or  there  may  only  be  one  repair- 
man. Item  failures  may  depend  on  item  usage,  but  total  usage  is  held  constant  over  the  sys- 
tem; hence,  the  more  items  working,  the  less  usage,  and  thus  the  less  exposure  to  failure  there 
is  for  each  of  the  working  items.  This  system  is  analogous  to  an  M/M/1  queueing  model:  the 
system  has  one  server  (repairman),  and  the  arrivals  to  the  system  (failures)  occur  at  a constant 
rate  independent  of  the  queue  length  (number  of  working  items). 

System  B differs  from  System  A in  that  the  failure  rate  (A„)  now  depends  on  the  number 
of  working  items  ( K - n).  For  instance,  item  failure  again  depends  on  item  usage,  but  now 
individual  item  usage  is  constant  for  all  working  items  and  does  not  depend  on  the  number  of 
working  items.  Thus,  total  usage  and  hence  the  failure  rate  increase  with  the  number  of  work- 
ing items. 
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System  C differs  from  System  A in  that  the  repair  rate  (/*„)  now  depends  on  the  number 
of  failed  items  ( n ).  The  repair  facility  has  sufficient  capacity  or  repairmen  to  be  able  to  work 
concurrently  on  all  failed  units.  This  system  is  analogous  to  the  queueing  system;  the 

system  has  an  infinite  number  of  servers  (infinite  repair  capacity),  but  arrivals  to  the  system 
(failures)  are  governed  by  a constant  arrival  rate. 

System  D assumes  that  the  repair  rate  (/*„)  depends  on  the  number  of  failed  items  and 
the  failure  rate  (X„)  depends  on  the  number  of  working  items. 

We  have  computed  and  graphed  the  system  failure  time  distributions  for  the  four  systems 
for  fi  - 1,  X - 0.2  and  for  n - 1,  X - 0.5.  For  each  system  and  each  set  of  parameter  values 
(X,  /*),  we  have  graphed  (1)  the  survival  functions  for  the  system  failure  times,  and  (2)  the  log 
of  the  survival  functions  for  the  system  failure  times.  In  addition,  for  each  system  and  for  each 
set  of  parameter  values,  Pu  wili  represent  the  steady-state  probability  that  the  system  is  in  an 
unacceptable  state  (N(t)  > Nc  — 5).  This  probability  will  be  an  indication  of  the  reliability  of 
the  system. 

From  Figures  3 through  10,  the  properties  of  the  system  failure  times  are  quite  evident. 
The  survival  functions  and  their  logs  are  clearly  ordered.  The  quasi-stationary  failure  time  is  a 
pure  exponential;  its  log  survival  function  is  linear.  Furthermore,  from  the  graphs  of  the  log 
survival  functions,  the  log-convexity  of  the  ergodic  failure  time  and  post-recovery  time  are 
quite  evident,  as  is  the  log-concavity  of  the  failure  time  from  the  perfect  state.  It  is  also  clear 
from  the  log  survival  functions  that  all  four  of  the  system  failure  times  are  quite  exponential  in 
nature.  Each  of  their  log  survival  functions  quickly  becomes  linear  (i.e.,  the  survival  function 
is  exponential)  and  parallel.  Thus,  after  an  initial  "burn-in"  stage,  each  of  the  four  system 
failure  times  behaves  as  if  it  were  a pure  exponential  — that  is,  the  rate  of  system  failure  is 
constant  over  time.  In  addition,  we  see  that  for  highly  reliable  systems  (e.g.,  system  A,  system 
C,  or  system  D),  as  denoted  by  Pu,  the  system  failure  times  are  essentially  exponential.  Here, 
the  ergodic  failure  time  and  the  failure  time  from  the  perfect  state  coincide  with  the  quasi- 
stationary  failure  time,  while  the  post-recovery  failure  time  differs  from  these  only  by  an  initial 
displacement  of  probability.  This  initial  displacement  of  probability  is  what  we  defined  to  be 
jitter;  that  is,  it  represents  the  tendency  of  the  system  to  vacillate  on  the  boundary  between  the 
acceptable  and  unacceptable  regions.  For  system  B,  for  the  particular  parameter  values  (X,  /i) 
that  we  have  considered,  the  system  is  not  reliable;  here  the  four  system  failure  times  are  quite 
distinct.  However,  as  previously  mentioned,  the  system  failure  times  for  system  B are  still 
quite  exponential  in  nature,  as  seen  by  the  log  survival  functions,  which  become  linear  and 
parallel. 

In  summary,  this  evidence  clearly  supports  the  possible  utility  of  these  system  failure 
times  in  decision-making.  For  reliable  systems,  the  system  failure  times  are  essentially 
exponential,  and  consequently  they  can  be  completely  characterized  by  the  mean  values  of  the 
distributions.  Thus,  the  information  provided  by  these  system  failure  times  may  be  easily 
incorporated  into  any  analysis  concerned  with  the  inherent  trade-offs  in  a complex  system  (e.g., 
increasing  the  inventory  of  an  item  vs  decreasing  the  item’s  failure  rate  vs  increasing  the  capa- 
city of  the  repair  facility).  Furthermore,  for  more  realistic  real  world  models,  failure  and  repair 
time  distributions  need  not  be  and,  in  general,  will  not  be  exponentially  distributed.  However, 
the  presence  of  exponentiality  in  the  system  failure  time  distributions,  induced  by  reliability,  is  a 
robust  property,  i.e.,  the  property  is  not  sensitive  to  the  underlying  failure  and  repair  time  distri- 
butions. Hence,  the  conclusions  from  these  examples  are  extendable  to  more  realistic  systems. 
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In  this  section  we  will  indicate  how  the  analysis  presented  in  the  previous  section  for  a 
single-item  inventory  system  may  be  extended  to  multi-item  inventory  systems. 

A.  System  Failure  Times 

Suppose  now  that,  instead  of  a single-item  inventory,  one  has  R items  with  independent 
inventories  for  each.  One  might  have,  for  example,  a squadron  of  aircraft,  with  certain  key 
costly  items,  such  as  engines  or  radars,  considered  as  modules  of  special  concern.  For  a 
minimally  acceptable  number  of  aircraft  Nc  to  be  operating,  it  is  essential  that  there  be  2NC 
available  engines  or  Nc  radars,  for  instance.  At  any  given  time  t,  component  j will  have  N2(t ) 
available  (in  use  plus  functioning  spares),  and  these  availability  levels  for  each  item  will  fluctu- 
ate with  failures  and  repairs  (or  replacements).  To  extend  the  ideas  of  Section  IU  to  this 
multi-item  context,  one  must  discuss  the  failure  time  of  the  system,  i.e.,  the  random  time  that 
elapses  between  some  known  initial  satisfactory  configuration  of  inventory  levels  (system  state) 
and  a system  failure  brought  about  by  one  of  the  key  item  inventory  levels  falling  below  the 
level  needed  for  Nc  operating  aircraft. 

If  the  failure  time  for  the  inventory  level  of  type  1,  2,  , R is  T{,  T2 TR, 

respectively,  then  the  system  failure  time  is 

r-min(r,,  T2 Tr). 

The  failure  time  distribution  for  the  system  will  be  described  by  its  survival  function  Fe(t), 
and  one  clearly  has,  from  the  independence  of  the  item  inventories, 

(47)  P[T  > t]  - PIT,  > r]  P[T2  > t]  ...  P[Tr  > r], 
i.e., 

(48)  Ft(t)  = Fft  (t)  FTi  (r)  ...  FTr(t). 

Just  as  one  can  speak  (as  in  Section  II)  of  four  basic  failure  times  of  interest  for  each  item 
inventory,  one  can  now  speak  of  four  corresponding  failure  times  for  the  system,  characterized 
by  the  following  initial  conditions: 


System  Failure  Time  from  the  Perfect  State 

Here,  at  / — 0,  all  inventories  are  perfect  so  that 

(49)  FP(r)  - #>,( r)  FP2(t)  . . . FPR( r), 

«. 

where  FPr(r ) is  the  survival  function  for  the  failure  time  of  the  r th  inventory  from  the  perfect 
state. 

X 

Ergodic  Failure  Time  for  the  System 

At  t - 0,  each  inventory  is  in  its  steady  (ergodic)  state,  conditional  on  the  inventory  level 
being  acceptable,  i.e.,  the  initial  state  for  each  inventory  is  precisely  that  for  the  ergodic  failure 
time  of  that  inventory.  It  follows  again,  from  independence,  that 

(50)  Fe(t)  = Fex(t)  FE2( r)  ...Fer(t). 
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Quasi-Stationary  Failure  Time  for  the  System 

At  t — 0,  each  inventory  is  in  its  steady  state,  conditioned  on  the  inventory  state  being 
acceptable  and  the  inventory  having  been  acceptable  for  as  long  as  anyone  can  remember. 
Independence  then  implies  that 

(51)  Fq(t)  — Tqi(t)  Fq2(t)  ...  FqK(t). 

Post-recovery  Failure  Time 

Here,  it  is  known  that  the  system  has  had  a long  history  and  has  just  had  a recovery  i e 
one  of  the  inventory  subsystems  has  just  recovered,  and  all  other  item  subsystems  are  working! 
Then  the  system  survival  function  Fy(r)  may  be  seen  to  be 

(52)  Fy(r)  = 9t  Fyj(r)  F£2(t)  ...  Fer(t) 

+ »2^£i(t)Fk2(t)  ...  Fer(t) 

+ 

+ 9rFE\(t)FE2(t)  ...  Fvr(t). 

where  Fyr(r ) is  the  post-recovery  survival  function  for  the  type-/-  inventory  subsystem  alone. 
The  parameter  0r  is  the  relative  long-run  frequency  of  system  failures  due  to  subsystem  failures 

R 

of  type  r so  that  9,  > 0,  21  “ 1. 

i 

For  birth-death  models  used  to  describe  the  individual  item  inventories,  the  long-run 
failure  frequency  of  the  type-r  inventory  is  (see  Section  III  for  these  birth-death  models): 

(53)  hr-  e </'  X (.rl 

"r  't 

and 

(54) 

I*. 

I 

where  n,  is  the  critical  level  for  component  type  r,  e^r)  is  the  steady-state  (ergodic)  probability 
that  m items  are  failed,  and  \ (mr)  is  the  repair  rate  for  level  m , all  as  described  in  Section  III. 

B.  Properties  of  the  System  Failure  Times  and  their  Interrelation 

It  will  be  seen  from  equations  (49),  (50),  (51),  and  (52)  that  the  structure  of  the 
different  system  failure  time  distributions  and  their  interrelation  is  almost  identical  to  that  for 
the  single-item  inventory  subsystems  described  in  Section  II.  We  see  specifically  that 

(a)  Fp(t)  is  log-concave; 

Fq(t)  is  log-linear; 

Ff(r)  is  log-convex; 

Fy( t)  is  mg-convex  . 

(b)  Fp(t)  ^ Fq(t)  > Ff(t)  > Fv{r)\  i.e.,  the  system  failure  time  survival  functions  are 
ordered  precisely  as  before.  Consequently, 


i 


a 


j 


J 


... 
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(c)  Tp  > Tq  7V; 

that  is,  the  mean  failure  times  have  the  same  order. 

(d)  When  the  inventory  subsystems  are  highly  reliable,  Fp,(r),  Fq,(t),  and  F£,(t)  virtu- 
ally coincide  for  each  item  r,  and  all  are  exponential.  Consequently,  the  system  failure  time  sur- 
vival functions  FP(r ),  Fq(t ),  and  Fe(t)  will  coincide  and  will  be  exponential. 

(e)  Because  of  the  exponentiality,  the  system  may  then  be  described  by  a single  parame- 
ter, its  failure  rate  X,  with 

K 

X - I Xr 

r-1 


where  Xr  is_the  failure  rate  of  inventory  system  r,  and  T,  is  the  mean  failure  time  of  subsystem 
r.  (Here,  Tr  ~ Tq,  ~ TE,  ~ Tp,.) 

(f)  The  system  post-recovery  failure  time  survival  function  will  then  lie  below  the  other 
survival  functions  to  the  extent  to  which  there  is  jitter  in  the  individual  item  inventories.  The 
jitter  factor  for  each  subsystem  may  be  defined  to  be 


/ .•  Vt) 

Jr  - lim  -f-JT- 
T-“  Fy,{r) 

It  then  follows  at  once,  from  the  multiplicative  structure  of  (49),  (50),  (51),  and  (52),  that  the 
system  jitter  factor 

J “ ,im  - Jr- 

~ /v(r) 

V.  AN  EXAMPLE  ILLUSTRATING  THE  IMPORTANCE 
OF  DYNAMIC  INFORMATION 

In  this  section  an  example  is  presented  showing  the  limitations  of  static  analysis  and  the 
corresponding  need  for  an  understanding  of  the  dynamic  system  behavior.  The  example  is 
simplistic,  but  it  does  clearly  state  the  case  for  dynamic  over  static  analysis. 

Consider  a single-item  system  that  can  be  modeled  as  a birth-death  process.  Using  the 
notation  of  Section  IIIC,  suppose  that  X„  — failure  rate  — (K  - n)X,  and  — repair  rate  — 
fi.  Assume  that  K — 10  and  Nc  - 3;  that  is,  there  are  ten  identical  items  in  the  system,  and 
at  least  seven  of  them  must  be  working  for  the  system  to  be  in  an  acceptable  state.  Assume  for 
the  current  system  that  X — 0.1  and  n - 1. 

The  static  analysis  of  this  system  yields  an  ergodic  probability  of  being  in  the  unacceptable 
state,  Pu,  of  0.223.  The  dynamic  analysis  will  provide  distribution  information  on  the  four 
failure  times  previously  defined.  For  this  example,  we  will  restrict  our  attention  to  just  the 
post-recovery  failure  time  or  sojourn  time  on  the  acceptable  region.  The  expected  sojourn  time 
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on  the  acceptable  region  is  7.18  time  units,  while  the  expected  sojourn  time  on  the  unaccept- 
able region  is  2.06  time  units.  This  implies  that  the  system  will  alternate  between  being  in  the 
satisfactory  state  and  being  in  the  unsatisfactory  state;  on  average  it  will  spend  7.18  time  units 
in  the  satisfactory  state  followed  by  2.06  time  units  in  the  unsatisfactory  state. 

Now  suppose  there  are  two  alternative  and  exclusive  options  for  improving  the  system’s 
performance.  The  first  option  would  increase  the  repair  rate  from  p.  - 1 to  p - 2.  The  second 
option  would  decrease  the  failure  rate  by  cutting  X from  0.1  to  0.05.  In  comparing  these  two 
options,  the  static  analysis  would  find  that  each  option  results  in  Pu  - 0.024.  Hence,  based  on 
the  static  analysis,  we  are  indifferent  between  the  two  options,  assuming  that  they  are  compar- 
able in  terms  of  implementation  and  cost. 

However,  the  two  options  result  in  quite  distinct  system  behavior,  as  can  only  be  seen 
from  the  dynamic  analysis.  In  terms  of  the  sojourn  times,  the  first  option  which  increases  the 
repair  rate  will  have,  on  average,  a sojourn  time  of  28.81  time  units  in  the  acceptable  state,  fol- 
lowed by  0.70  time  units  in  the  unacceptable  state.  This  is  to  be  contrasted  with  the  second 
option,  for  which  the  respective  expected  sojourn  times  are  57.62  time  units  and  1.39  time 
units.  In  each  instance,  these  sojourn  times  can  be  considered  to  be  exponentially  distributed. 
Hence,  while  the  two  options  yield  the  same  availability  levels,  the  second  option  results  in 
average  sojourn  times  which  are  twice  as  long  as  for  the  first  option.  For  instance,  if  the  system 
has  just  failed,  then  the  average  time  until  recovery  to  the  acceptable  state  is  twice  as  long  for 
option  two  than  for  option  one;  that  is,  the  system  will  not  be  acceptable  for  1.39  time  units  as 
opposed  to  0.70  time  units. 

The  essence  of  this  result  carries  over  for  perhaps  more  meaningful  models.  For 
instance,  for  each  of  the  birth-death  systems  considered  in  Section  II1C,  an  example  with 
behavior  and  results  similar  to  the  one  just  given  can  be  constructed.  Indeed,  for  more  com- 
plex models  the  need  for  the  dynamic  analysis  is  generally  greater  due  to  the  inherent  complex- 
ity of  the  system’s  behavior. 

The  intent  of  this  example  has  been  to  illustrate  the  differences  in  information  from  static 
analysis  and  dynamic  analysis.  The  system  considered  is  admittedly  very  simplistic,  but  the 
conclusions  from  the  example  are  equally  applicable  to  more  complex  and  realistic  systems. 
Whereas  the  static  analysis  is  unable  to  distinguish  between  two  potential  system  configurations, 
the  dynamic  analysis  shows  that  there  is  a distinct  difference.  The  example  shows  that  the 
static  analysis  is  limited,  and  must  be  supplemented,  if  not  replaced,  by  dynamic  analysis  if  one 
is  to  understand  the  full  implications  of  various  design  trade-offs.  Of  course,  in  any  actual 
application  the  cost  differences  between  the  various  alternatives  must  also  be  considered.  For 
instance,  if  there  is  a fixed  cost  budget,  design  alternatives  are  to  be  chosen  so  as  to  maximize 
the  performance  of  the  system  subject  to  the  budget  constraint.  In  order  to  reflect  completely 
the  system  performance  for  a specific  configuration,  the  dynamic  analysis  is  necessary. 
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ABSTRACT 

The  main  objective  of  this  paper  is  to  develop  a mathematical  model  Tor  a 
particular  type  of  three-echelon  inventory  system  The  proposed  model  is  be- 
ing used  by  the  Air  Force  to  evaluate  inventory  investment  requirements  for 
alternative  logslic  structures.  The  system  we  will  model  consists  of  a group  of 
locations,  called  bases,  and  a central  depot.  The  items  of  concern  in  our 
analysis  are  called  recoverable  items,  that  is.  items  that  can  be  repaired  when 
they  fail.  Furthermore,  each  item  has  a modular  or  hierarchical  design. 
Briefly,  the  model  is  used  to  determine  the  stock  levels  at  each  location  for 
each  item  so  as  to  achieve  optimum  inventory-system  performance  for  a given 
level  of  investment.  An  algorithm  for  the  computation  of  stock  levels  for  each 
item  and  location  is  developed  and  illustrated.  Some  or  the  ways  the  model 
can  be  used  are  illustrated  with  Air  Force  data. 


INTRODUCTION 

The  main  objective  of  this  paper  is  to  develop  a mathematical  model  for  a particular  type 
of  three-echelon  inventory  system.  The  model  is  being  used  by  the  Air  Force  to  evaluate 
inventory  investment  requirements  for  alternative  logistics  structures.  The  system  we  will 
study  consists  of  a group  of  locations,  called  bases,  and  a central  depot.  The  items  of  concern 
in  our  analysis  are  called  recoverable  items,  that  is,  items  that  can  be  repaired  when  they  fail. 
Briefly,  the  model  will  be  used  to  determine  what  the  stock  levels  should  be  at  each  location  for 
each  item  so  as  to  achieve  optimum  inventory-system  performance  for  a given  level  of  invest- 
ment. 

We  assume  that  each  item  in  the  system  has  a hierarchical  or  modular  design.  By  a 
hierarchically  designed  recoverable  item  we  mean  one  that  has  components  which  are  also 
recoverable  items.  In  the  Air  Force  context,  when  an  aircraft  fails,  a recoverable  assembly  is 
often  found  to  be  faulty.  It  is  removed  from  the  aircraft  and  replaced  by  a serviceable  assembly 
of  the  same  type.  If  this  failed  assembly  has  a hierarchical  design,  it  may  be  taken  to  a shop  on 
the  base  where  a faulty  recoverable  component  may  be  identified.  To  return  the  failed  assem- 
bly to  a serviceable  condition  requires  the  removing  and  replacing  of  the  defective  recoverable 
component.  For  example,  many  avionics-system  components  on  newer  aircraft,  such  as  the 

•This  research  was  supported  in  pari  by  the  Oflice  of  Naval  Research  under  contract  NOOOI4-75-C-1 172  Task  NR042- 
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radar-target  digital  processor  on  the  Air  Force’s  new  F-15  fighter,  have  this  type  of  hierarchical 
design.  This  assembly  has  many  recoverable  components  which  are,  for  the  most  part, 
integrated-circuit  boards.  Recognition  and  description  of  the  hierarchical  relationship  among 
the  recoverable  items  is  a major  element  of  the  model  we  will  develop.  As  we  will  see,  the 
relationship  between  the  stocking  of  inventories  of  assemblies  and  recoverable  components  at 
one  echelon  and  the  performance  at  that  and  lower  echelons  is  demonstrated  through  the  equa- 
tions for  the  average  resupply  time  for  each  base.  These  equations  are  the  backbone  of  the 
model. 

The  three-echelon  system,  as  we  have  stated,  consists  of  a group  of  bases  and  a depot. 
Each  base  is  capable  of  performing  only  certain  types  of  maintenance.  Some  bases,  which  form 
the  second  echelon,  have  extensive  repair  centers,  called  maintenance  centers,  collocated  with 
them.  The  remaining  bases,  called  operating  bases,  perform  only  a minimal  amount  of  mainte- 
nance. These  bases  comprise  the  third  and  lowest  echelon.  By  definition,  an  operating  base 
does  not  have  a collocated  maintenance  center.  Lastly,  the  depot,  the  first  echelon,  has  the 
capability  to  perform  all  types  of  repair. 

Each  customer  demand  occurs  at  a base  and  is  always  a requisition  for  a serviceable 
assembly.  Furthermore,  we  assume  that  each  customer  demand  is  triggered  by  the  failure  of  an 
assembly.  The  failed  assembly  is  then  repaired  either  at  a maintenance  center  or  at  the  depot. 
The  location  at  which  repair  takes  place  depends  only  on  the  nature  of  the  failure.  Maintenance 
centers  repair  assemblies;  they  use  diagnostic  equipment  located  in  shops  to  isolate  the  assem- 
blies’ defective  components.  In  some  instances,  these  components  may  also  be  repaired  at  the 
maintenance  center,  although  in  most  real  applications  they  are  normally  repaired  at  the  depot. 
Since  repair  of  assemblies  is  performed  only  at  maintenance  centers  and  at  the  depot,  com- 
ponents need  to  be  stocked  only  at  the  depot  and  at  bases  having  a collocated  maintenance 
center.  Assemblies,  on  the  other  hand,  can  be  stocked  at  all  locations. 

Customer  demands  for  serviceable  assemblies  are  always  satisfied  by  an  organization  at 
each  base  called  base  supply.  If  a serviceable  spare  assembly  is  immediately  available  from  base 
supply,  the  customer  demand  is  satisfied  immediately.  On  the  other  hand,  if  no  serviceable 
stock  is  on  hand,  the  assembly  is  placed  in  a backorder  status  and  the  satisfaction  of  the  custo- 
mer demand  is  delayed.  As  we  have  described,  the  failed  assembly  is  then  either  repaired  at 
the  base  or  sent  to  a higher  echelon  to  be  repaired. 

Correspondingly,  resupply  of  base  supply  can  occur  in  one  of  two  ways.  If  a failed  assem- 
bly is  repaired  at  a maintenance  center,  resupply  occurs  from  the  maintenance  center;  if  the 
assembly  is  repaired  at  the  depot,  then  resupply  will  occur  from  the  depot.  In  either  case,  the 
organization  that  resupplies  the  base  supply  activity  does  so  by  exchanging  a serviceable  part  for 
a failed  part  on  a one-for-one  basis.  The  resupply  time— that  is,  the  time  it  takes  to  replace  an 
assembly  demanded  from  base  supply  with  a serviceable  one— depends  on  the  source  of  resup- 
ply. For  example,  at  a base  having  a collocated  maintenance  center,  the  average  resupply  time 
for  base  supply  for  an  assembly  equals  the  average  repair  time  when  the  assembly  is  repaired  at 
the  maintenance  center.  The  average  repair  time  for  the  assembly  clearly  depends  on  the  avai- 
lability of  the  components  needed  to  accomplish  the  repair.  If  adequate  component  stocks  are 
on  hand,  repair  will  be  completed  with  minimal  delay.  On  the  other  hand,  if  repair  of  the 
assembly  takes  place  at  the  depot,  the  average  resupply  time  for  base  supply  equals  the  average 
depot-to-base  shipping  time  plus  the  expected  waiting  time  before  a serviceable  assembly  is 
available  for  shipment  to  the  base.  This  expected  waiting  time  depends  on  the  depot  stock 
level  for  the  assembly. 
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Additionally,  in  this  three-echelon  system  we  will  assume  the  structure  of  the  supply  and 
maintenance  system  for  an  assembly  family— an  assembly  and  its  subordinate  components— can 
be  represented  by  a tree,  as  displayed  in  Figure  1.  Specifically,  we  assume  that  the  set  of  bases 
can  be  partitioned  into  a collection  of  mutually  exclusive  and  collectively  exhaustive  sets.  Each 
set,  which  has  exactly  one  maintenance  center  and  a collection  of  operating  bases  logistically 
supported  by  the  maintenance  center,  is  called  a Consolidated  Support  Family.  Each  operating 
base  is  assumed  to  receive  all  maintenance-center-level  resupply  from  the  maintenance  center 
in  its  Consolidated  Support  Family. 


Figure  I The  supply  and  mainienance  system  for  an  assembly  family 


Bases  at  which  a maintenance  center  is  located  may  or  may  not  have  customers  requesting 
serviceable  assemblies.  If  the  base  has  such  customers,  all  requests  for  spare  assemblies  are 
made  to  the  base  maintenance  center.  The  maintenance  center  performs  all  resupply  for  all 
customers  at  that  base  and  is  also  a resupply  point  for  all  the  operating  bases  in  the  same  Con- 
solidated Support  Family.  Some  assemblies  that  fail  at  a base  having  a maintenance  center  are 
repaired  at  the  base,  but  others  may  be  sent  to  the  depot  for  repair.  We  assume,  for  the  sake 
of  simplicity,  that  any  failed  assembly  sent  to  a location  for  repair  by  a lower-echelon  base  is 
not  sent  on  and  is  repaired  there. 

In  the  next  section  we  develop  a mathematical  model  for  the  system  we  have  described 
for  a single  hierarchically  designed  item.  The  model  recognizes  the  hierarchical  relationship 
among  the  recoverable  items,  and  it  explicitly  accounts  for  the  relationship  between  the  stock- 
ing of  inventories  of  assemblies  and  components  at  one  echelon  and  the  performance  at  that 
echelon,  as  well  as  at  other  echelons.  An  analytic  solution  is  obtained  for  the  three-echelon 
stockage  problem  under  the  steady-state  demand  assumption.  Under  this  assumption,  the  solu- 
tion depends  only  on  the  mean  resupply  times  rather  than  on  the  resupply  time  distributions. 
Mathematical  results  are  stated  in  terms  of  the  Poisson  assumption,  but  they  can  be  readily 
extended  to  cover  the  compound  Poisson  case. 

The  third  section  contains  a description  of  an  algorithm  for  computing  stock  levels  for  the 
assembly  and  its  components.  A method  for  computing  stock  levels  for  systems  consisting  of  a 
large  number  of  assemblies  is  presented  and  illustrated  in  Section  IV. 
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The  model  presented  in  this  paper  was  developed  originally  to  assist  Air  Force  planners  in 
their  study  of  alternatives  to  the  Air  Force’s  current  two-echelon  (depot-base)  logistics-system 
structure.  In  the  current  system,  all  bases  have  collocated  maintenance  centers.  The  model  is 
being  used  to  assess  the  differences  in  stockage  requirements  between  the  Air  Force’s  current 
structure  and  the  three-echelon  structure  described  previously.  Some  of  the  ways  the  model 
can  be  used  are  illustrated  in  Section  V with  Air  Force  data.  The  illustrations  provide  some 
interesting  insights  into  how  inventory  requirements  change  when  a three-echelon  system  is 
operated  rather  than  a two-echelon  system. 


I 

I 

) 
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The  final  section  contains  a brief  summary  and  an  example  that  indicates  that  using  rela- 
tively sophisticated  inventory  models,  such  as  the  one  described  in  this  paper,  will  significantly 
improve  system  performance  for  the  same  level  of  investment  over  that  obtained  using  simple 
models. 

II.  THE  MODEL 

The  three-echelon  system  described  in  Section  I is  an  extension  of  the  two-echelon 
MOD-METRIC  model  [4}.  For  simplicity,  we  temporarily  consider  only  one  assembly  family. 
Later  we  extend  the  results  to  the  situation  in  which  there  are  an  arbitrary  number  of  assembly 
families. 


The  model’s  objective  is  to  determine  the  stock  levels  for  the  depot,  for  bases  with 
maintenance  centers,  and  for  operating  bases  that  minimize  expected  backorders  for  assemblies 
at  all  bases,  subject  to  a constraint  on  total  investment  in  assemblies  and  components.  More 
precisely,  a function  measuring  the  expected-backorder-days  is  to  be  minimized.  An  assembly 
backorder  exists  whenever  a demand  for  a serviceable  assembly  cannot  be  satisfied  by  base  sup- 
ply at  the  base  at  which  the  assembly  failure  occurred.  Assembly-resupply  delays  at  the  depot 
or  at  a maintenance  center  are  measured  in  the  model  only  insofar  as  they  influence  backorders 
for  assemblies  at  bases;  component  shortages  are  also  measured  indirectly.  Observe  that  a 
backorder  for  an  assembly  at  a base  indicates  that  a customer  demand  is  unsatisfied.  Since 
components  are  only  used  to  repair  assemblies,  a component  backorder  only  delays  repair  of  the 
assembly;  it  does  not  directly  cause  a customer's  demand  to  be  unsatisfied  immediately.  Conse- 
quently, the  impact  of  assembly  and  component  backorders  on  customer  satisfaction  is  quite 
different.  We  describe  the  exact  nature  of  the  assembly/component  interaction  in  detail  later  in 
this  section. 

Before  presenting  the  mathematical  model  for  this  decision  problem,  we  first  state  the 
underlying  assumptions  and  then  develop  the  average  resupply-time  equations  for  assemblies 
for  all  bases.  As  will  be  shown,  these  equations  are  the  backbone  of  the  model.  They 
represent  the  manner  in  which  assembly  and  component  stock  levels  interact,  and  they  expli-  * 

citly  state  how  resupply  capability  for  each  echelon  depends  on  the  stock  levels  for  all  higher 
echelons.  Having  established  these  equations,  we  next  determine  the  probability  distributions 
describing  the  number  of  units  in  resupply  for  each  location.  Using  these  probabilities,  we  can  '4 

then  calculate  the  expected  number  of  assembly  backorders  outstanding  at  any  time  at  each 
base;  that  is,  we  can  state  the  model’s  objective  function. 

Basic  Assumptions 

The  basic  assumptions*  underlying  the  model,  in  addition  to  those  mentioned  earlier, 
include: 


*A  complete  discussion  of  these  assumptions  and  their  implications  is  given  in  Ref.  7 
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1.  Demand  for  assemblies  at  each  base  is  a stationary  Poisson  process. 

2.  There  is  no  lateral  resupply  among  bases.* 

3.  All  failed  parts  are  repaired. 

4.  The  probability  of  a failure  of  one  assembly  is  independent  of  failures  occurring 
for  other  assemblies. 

5.  Repair  times  are  statistically  independent. 

6.  There  is  no  waiting  or  batching  of  items  before  starting  the  repair  of  any  item. 

7.  The  echelon  at  which  repair  is  performed  depends  only  on  the  complexity  of  the 
repair. 

8.  Each  assembly  failure  repaired  at  a maintenance  center  is  caused  by  a failure  of  at 
most  a single  component. 

Ayerage-Resupply-Tlme  Equation  for  Assemblies 

After  defining  some  necessary  notation,  we  first  derive  the  average-resupply-time  equation 
for  assemblies  for  each  maintenance  center  and  describe  in  detail  the  exact  nature  of  the 
assembly/component  interaction.  Next,  we  develop  the  average-resupply-time  equations  for 
assemblies  for  both  the  bases  having  collocated  maintenance  centers  and  the  operating  bases 
subordinate  to  the  maintenance  centers. 

Let  N - {1,  . . . ,n,}  denote  the  set  of  locations  having  maintenance  centers,  and  let  N(k) 
denote  the  set  of  locations  resupplied  by  A € TV;  let  M - {/7]+l,  ...,n  \ be  the  set  of  operating 
bases.  An  index  J will  refer  to  an  operating  base,  an  index  Ac  to  a base  having  a collocated 
maintenance  center,  and  index  0 will  refer  to  the  depot. 

Let 

A'*  A expected  daily  customer  demand  for  assemblies  at  the  base  collocated 
with  maintenance  center  k,  k € N; 

k'  j A expected  daily  customer  demand  for  assemblies  at  operating  base  j,  j € A/; 

**>,,  A probability  that  a failed  assembly  occurring  at  location  v is  both  repaired 
and  resupplied  by  location  r; 

kit  A expected  daily  resupply  requests  for  assemblies  levied  on  maintenance  center 
k,  k € N. 


The  expected  number  of  requests  for  resupply  for  assemblies  levied  on  maintenance  center  k 
equals  the  expected  number  of  daily  assembly  failures  at  the  base  collocated  with  maintenance 
center  k plus  the  expected  number  of  daily  resupply  requests  for  assemblies  generated  by 
lower-echelon  bases  supported  by  maintenance  center  k.  Thus, 

kk  ” k\  + £ »>ikk'). 

j(N(k) 

‘This  assumption  is  consistent  with  Air  Force  policy  for  computing  recoverable  item  stock  levels  and  was  made  for  this 
reason. 
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Furthermore,  let 

r' k A probability  that  an  assembly  failure  at  the  base  collocated  with  maintenance 
center  k is  repaired  at  maintenance  center  k; 

A probability  that  an  assembly  arrival  to  maintenance  center  k is  repaired  there 
(see  the  next  paragraph  for  a discussion  of  /•*); 

Bv  A the  expected  assembly  repair-cycle  time  at  location  v,  measured  in  days,  including 
repair-time  delay  for  unavailable  components,  v - 1,  . . . ,n; 

Av,  A the  expected  order-and-ship  time  between  f and  v for  assemblies  measured 

in  days  where  t - 0,  . . . ,n,  and  v = 1 n\ 

D A the  expected  depot  repair-cycle  time  for  assemblies  measured  in  days; 
s,  A the  stock  level  for  the  assembly  at  location  t.  * 


By  assumption,  all  failed  assemblies  shipped  from  an  operating  base  to  maintenance  center 
k are  actually  repaired  at  maintenance  center  kr,  however,  some  assemblies  that  fail  at  the  base 
collocated  with  maintenance  center  k are  sent  to  the  depot  for  repair.  Then  the  expected 
number  of  failed  assemblies  arriving  at  maintenance  center  k each  day  that  are  repaired  there 
equals  the  total  number  of  maintenance-center- k expected  daily  resupply  requests  minus  the 
expected  number  of  assembly  failures  per  day  occurring  at  the  base  collocated  with  maintenance 
center  k that  require  depot-level  repair.  Thus,  the  probability  that  an  assembly  arriving  at 
maintenance  center  k will  actually  be  repaired  there  is 


\'k 

(l  ~ r\)  . 


We  are  now  ready  to  establish  the  equation  for  the  average  resupply  time  for  assemblies  for 
maintenance  center  k,  which  we  denote  by  Tk.  The  expected  assembly  resupply  time  at  mainte- 
nance center  k equals  the  probability  rk  that  the  assembly  will  be  repaired  at  maintenance  center 
k times  the  average  maintenance-center-A  assembly-repair  time  Bk  plus  the  probability  the 
assembly  will  be  repaired  at  the  depot  (1  — rk)  times  the  average  depot-to-maintenance  center  k 
resupply  time. 


The  average  depot-to-maintenance  center  k resupply  time  equals  the  average  assembly 
order-and-ship  time  Ak0  plus  the  expected  number  of  days  before  a serviceable  assembly  is 
available  at  the  depot  for  shipment  to  the  base.  This  depot  delay  time  can  be  found  from  the 
following  formula:  expected  delay  days  per  demand  equals  the  expected  number  of  assemblies 
being  delayed  at  any  point  in  time-the  expected  number  of  depot  backorders-divided  by  the 
expected  daily  depot  demand  rate  for  assemblies.  Let 

* “ w'0*'r  • 

i-i 

the  expected  number  of  daily  demands  for  assembly  resupply  placed  on  the  depot,  it  follows 
from  assumptions  1 and  4 that  p(x|AD)— the  probability  that  x assemblies  are  in  resupply  at 
the  depot,  given  that  the  expected  demand  over  the  depot  resupply  cycle  is  kD—  has  a Poisson 
distribution  with  mean  KD.  Thus,  the  expected  number  of  delay  days  experienced  by  each 
assembly  resupplied  by  the  depot  can  be  expressed  as 


‘The  slock  level  is  defined  lo  be  the  on-hand  plus  on-order  inveniory  minus  backorders. 
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//(So)  A 


expected  depot  backorders  given  the  depot  assembly  stock  level  s0 
expected  daily  depot  demand  for  assemblies 


or 


//(Sq)  A 


1 


I 

x>s„ 


(x  - s<)p(x\kD) 


Combining  these  observations,  we  see  that  the  average  assembly-resupply  time  at  mainte- 
nance center  k can  be  expressed  as  Tk  - rkBk  + (1  - rk)  [Ak0  -4-// (sq)).  This  equation  indi- 
cates how  the  depot  stock  affects  the  average  resupply  time  for  assemblies  at  maintenance 
center  k. 


But  Tk  also  depends  on  the  component  stock  levels.  The  average  assembly  repair-cycle 
time  Bk  at  maintenance  center  k is  the  sum  of  two  terms.  The  first  reflects  the  portion  of  the 
repair-cycle  time  related  to  the  operation  of  the  maintenance  and  transportation  systems.  In 
particular,  this  term  represents  administrative  delay  time  plus  queuing  time,  plus  fault  isolation 
time,  plus  component  remove-and-replace  time.  It  also  includes  transportation  time,  if  the 
assembly  is  sent  to  maintenance  center  k for  repair  by  an  operating  base.  Denote  this  portion 
of  the  average  assembly  repair-cycle  time  by  Rk. 


The  second  term  reflects  expected  delay  in  completing  an  assembly's  repair  due  to  the 
shortage  of  serviceable  components.  If  a particular  component  is  the  cause  of  the  assembly's 
failure  and  no  serviceable  component  of  that  type  is  on  hand,  then  the  assembly  repair  time  is 
lengthened.  Consequently,  Bk  depends  on  component  stock  levels  both  at  maintenance  center 
k and  at  the  depot.  Let  Gk(s/k,  . . . ,smk\  s10,  ...  ,sm0)  A Gk  represent  the  average  delay  days  per 
demand  in  maintenance-center- k assembly  repair,  given  component  / stock  level  s,k  at  base  k 
and  component  / depot  stock  level  s(0>  where  m represents  the  number  of  different  components 
in  the  assembly.  We  will  now  develop  an  explicit  expression  for  Gk. 


Recall  we  assume  that  if  an  assembly  is  repaired  at  a maintenance  center,  at  most  one 
component  needs  to  be  replaced.  Then  the  expected  delay  in  assembly  repair  time  at  mainte- 
nance center  k,  given  the  failure  of  component  /,  is  the  expected  number  of  components  of 
type  / at  maintenance  center  k on  which  delay  is  being  incurred  at  any  point  in  time— the 
expected  backorders  for  component  / at  maintenance  center  A:— divided  by  the  expected  com- 
ponent i daily  removal  or  demand  rate  at  maintenance  center  k.  Denote  this  conditional 
expected  delay  by  gik\  that  is. 


^ expected  backorders  for  component  / at  maintenance  center  k at  any  point  in  time 
expected  daily  removal  rate  for  component  / at  k 


or 


<*  x > s. 


L (x  - s,k)p(x\\ikT,k) 


where 

klk  A average  number  of  daily  removals  of  component  i at  maintenance  center  Ar, 
rik  A probability  that  if  component  i fails  at  location  k,  the  component  will  be 
repaired  at  maintenance  center  Ar, 


i 
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B,k  A average  component  / repair  time  at  maintenance  center  k, 

Aio  A average  component  / order-and  -ship  time  from  the  depot  to  maintenance 
center  k, 

D,  A average  depot  repair-cycle  time  for  component  r, 

T,k  A average  resupply  time  for  component  / at  maintenance  center  k. 

The  average-resupply-time  equation  Tlk  for  component  i at  maintenance  center  k equals 
the  probability  rlk  that  the  component  is  repaired  at  maintenance  center  k times  the  average 
maintenance -center- At  repair  time  B,k  for  component  /,  plus  the  probability  the  component  will 
be  repaired  at  the  depot  (1  — rlk)  times  the  sum  of  the  depot-to-maintenance  center  order-and- 
ship  time  Ak0  and  the  expected  number  of  days  before  a serviceable  component  is  available  at 
the  depot  for  shipment  to  the  maintenance  center.  We  denote  this  latter  delay  by  H,k(s, ©), 
where 

expected  number  of  unsatisfied  depot  demands  for  component  / 

H (s  o)  A a*  any  po'nt  'n  l'me  *'ven  depot  stock  level  for  component  i is  j,0 
expected  daily  depot  demand  rate  for  component  i 


A f 


(x  - s(0)p(x|fl,D,)  . 


and  where 


“ Z Kk  0 ~ rik)  , 

k- 1 


p(x\0,D,)  - 


the  probability  of  x units  of  component  i 
in  depot  resupply  at  any  point  in  time 


-1,0,  (W 

9 ' ' 


T,k  - r(kB,k  -Ml  - rlt)lA'k0  + H,k{si0) ) . 

The  probability  that  an  assembly  failure  repaired  at  maintenance  center  k is  caused  by 
component  i is  Xik/rkKk.  Then  the  expected  delay  time  in  repair  of  an  assembly  at  maintenance 
center  k due  to  the  unavailability  of  component  stock  is  found  by  multiplying  the  conditional 
delays  gik  by  X J rkk k and  summing  over  component  types.  Thus, 

m \ . 

I 

1 rk*k 


We  have  now  seen  that  Bk  , the  average  repair  time  for  an  assembly  at  maintenance 
center  k , can  be  represented  as  the  sum  of  two  terms,  Rk  and  Gk.  We  therefore  have  shown 
that  the  average  resupply  time  for  an  assembly  at  maintenance  center  k can  be  represented  as 


mm 


r 


l 
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Tk  - rkBk  + (1  - r*)M*0  + //(s„)l 

— rk(,Rk  + Gk)  + (1  — rk)[Ak0  + H(sq)]. 

This  equation  indicates  how  the  depot  stock  level  for  the  assembly  and  the  maintenance  center 


k and  depot  component  stock  levels  affect  the  assembly  resupply  time  at  maintenance  center  k. 


We  now  develop  the  average-resupply-time  equation  for  base  k,  k € N.  Since  base  k is 
physically  collocated  with  the  maintenance  center,  no  assembly  stock  will  be  allocated 
exclusively  to  it.  Immediate  resupply  is  assumed  to  be  always  available  (zero  lead  time)  for 
customers  at  the  base  from  the  maintenance  center  if  serviceable  stock  is  on  hand.  From  a 
system’s  viewpoint  there  is  no  advantage  to  allocating  exclusive  stock  to  the  base,  since  all 
assemblies  assigned  there,  by  assumption,  would  be  unavailable  for  redistribution.  This  would 
degrade  expected  system  performance.  Since  all  resupply  for  customer  demands  at  base  k 
comes  from  maintenance  center  k,  the  average  resupply  time  for  an  assembly  for  base  k,  call  it 
T\ , equals  the  expected  number  of  delay  days  before  a serviceable  assembly  becomes  available 
at  maintenance  center  k.  Therefore, 

Or  - sk)p(.x\\kTk) 


T\ 


I 

X>Slr 


k € N . 


The  average-resupply-time  equation  for  operating  base  j,  call  it  Tn  can  be  found  by  the 
same  method  we  used  to  determine  Tk.  Let  us  temporarily  assume  that  location  j receives  res- 
upply from  maintenance  center  k.  Then  7}  equals  r,,  the  probability  that  the  failed  assembly  is 
repaired  at  base  j,  times  the  average  base  repair  time  for  the  assembly  B , plus  the  probability 
wjk  that  the  assembly  is  repaired  at  maintenance  center  k,  times  the  sum  of  maintenance  center 
k to  operating  base  j order-and-ship  time  A/k  and  the  expected  delay  in  shipment  due  to  the 
unavailability  of  a serviceable  assembly  at  maintenance  center  k (call  this  quantity  Hk(sk)),  plus 
the  probability  that  the  assembly  is  shipped  to  the  depot  for  repair  wi0  times  the  sum  of  the 
depot-to-base  j order-and-ship  time  /4)0  and  the  expected  delay  before  a serviceable  assembly  is 
available  at  the  depot  for  shipment  to  the  base  H(s0).  In  general,  let  g(J ) 6 N denote  the 
maintenance  center  for  which  wlk  > 0.  Then  we  may  express  the  average  resupply  time  for 
operating  base  j as 


Tj  “ f i B j + Wi,g(j)  t Ajgfl)  + H g ( ;)  ( ^ ( / ) ) 1 + Wjq[AjQ  + H(Sq)] 


The  average  number  of  days  a resupply  request  for  an  assembly  levied  on  maintenance 
center  k is  delayed  before  a serviceable  assembly  becomes  available  for  shipment,  given  the 
stock  level  sk , was  denoted  by  Hk(sk).  This  function  is 

expected  maintenance  center  k assembly  backorders  at  any 
„ , , . point  in  time  given  the  maintenance  center  k stock  level  of  s, 

ri  ( c J ii 

* k = expected  daily  assembly  demand  at  maintenance  center  k 
or 


Hk(sk)  k—  £ Or  - sk)p(x\\kTk)  , 


where  p(x\\kTk)  is  the  probability  of  x assemblies  in  the  maintenance-center-fc  resupply  sys- 
tem. In  the  expression,  p(x\\kTk)  is  approximated  by  a Poisson  distribution  whose  mean  is 
kkTk. 
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Mathematical  Statement  of  the  Model 

The  goal  of  the  model  is  to  find  the  assembly  and  component  stock  levels  for  each  loca- 
tion that  minimize  the  system's  average  number  of  backorders  for  customer  demands  for 
assemblies  outstanding  at  any  point  in  time,  subject  to  a restriction  on  inventory  investment. 
For  each  operating  base,  that  is,  for  each  j € A/,  we  express  the  average  number  of  outstanding 
backorders  at  any  time  for  customer  demands  for  assemblies  as 

£ Or  - Sj)p(x\\' ,Tj)  , 

where  Sj  represents  the  stock  level  for  the  assembly  at  base  j.  Recall  that  no  stock  is  explicitly 
allocated  to  the  base  at  a location  having  a maintenance  center.  All  stock  at  base  k is  under  the 
administrative  control  of  the  maintenance  center.  Thus,  the  average  number  of  customer 
backorders  for  assemblies  at  base  k at  any  time  is 

I xp(x\k\rk)  - x'*r* . 

x>0 

Therefore,  the  objective  function  for  the  model  is 

L £ Or  — Sy)p(x|X’y7})|  4-  £ X \Tk  . 

J(M  x>Sj  J ktN 

Note  that  the  backorder  expression  for  each  base  depends  on  its  average  resupply  time. 

The  inventory-investment  constraint  in  the  model  states  that  the  system  investment  in 
assemblies  and  components  cannot  exceed  some  maximum  value.  If 
c - the  unit  cost  of  an  assembly, 

c,  — the  unit  cost  of  component  /, 

s„  - stock  level  for  component  / at  location  r,  and 
C — the  available  budget, 

the  mathematical  representation  of  the  investment  constraint  is 

n m "l 

c £ ci  £ sn  ^ c . 

(-0  /-i  o 

Combining  the  above,  we  write  the  mathematical  statement  of  the  model  as  follows: 

(P)  min  £ j £ (x  - s,)/>U|X'j7,)}  + £ \\  T\ 


j€  M I *> 


" m I 

subject  to  c £ s,  + £ c(  £ sit  < C , 

t-0  /-I  1-0 

where  s,  and  s„  are  nonnegative  integers. 


t - 0 n,  and  / -1, 

We  will  call  this  Problem  P. 


Wat  v v , 
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III.  AN  ALGORITHM  FOR  DETERMINING  STOCK  LEVELS 

The  model’s  objective  function  represents  the  total  system  backorders  existing  at  any 
point  in  time  for  customer  demand  for  the  assembly.  As  stated  in  the  previous  section,  the 
expected  backorder  expression  for  the  assembly  for  each  operating  base,  that  is,  for  each 
j € M,  is 

£ Or  - s,)p(x\\' jTj)  , 

X>$I 

which  depends  on  T,.  But  Tj  is  a function  of  both  depot  and  maintenance-center  assembly  and 
component  stock  levels.  Similarly,  the  expected  backorder  expression  for  customer  demands 
for  assemblies  for  each  k € N depends  on  depot  assembly  and  component  stock  levels  as  well 
as  on  maintenance-center  stock  levels  for  components.  Consequently,  Problem  P is  not  a 
separable  programming  problem.  Furthermore,  the  objective  function  need  not  be  convex. 

The  strategy  we  employ  to  solve  Problem  P circumvents  these  difficulties.  Specifically,  we 
will  solve  a finite  sequence  of  subproblems,  each  corresponding  to  a fixed  investment  in  assem- 
blies. For  a fixed  total  budget  C,  it  is  possible  to  purchase  either  0,1 or  Q assemblies,  where 

Q is  the  greatest  integer  less  than  or  equal  to  C/c.  The  proposed  algorithm  requires  evaluating 
the  solution— at  least  implicitly—  to  Q + 1 subproblems,  one  for  each  possible  investment  in 
assemblies.  Each  subproblem  can  be  stated  as  follows: 

min  jjmin  £ £ (x  - s)p(x\\' jTj)  + £ k'kT\: 

sn  ||  ieM  »>j/  key 

s„  is  fixed  for  all  / and  t (thereby  establishing  the  component  delay  in  Tk ),  and 
s,  and  s,,  are  nonnegative  integers; 

t s,-N  , 

1-0 

where  N represents  the  number  of  assemblies  available  for  distribution,  and  N 
is  the  greatest  integer  less  than  or  equal  to 

C - £ c,  £ s„ 

<■  1 f—0 

c 

Consequently,  each  subproblem  can  be  two  partitioned  into  two  parts,  one  corresponding  to 
components  and  the^other  to  assemblies.  The  first  part  establishes  the  manner  in  which  a lim- 
ited budget  (C  - cN ) is  allocated  among  the  m components.  Once  a specific  allocation  of  com- 
ponents to  the  depot  and  maintenance  centers  has  been  determined,  the  expected  delay  in 
assembly  repair  time  due  to  components  is  known.  This  in  turn  affects  the  resupply  time  and 
ultimately  the  expected  backorders  for  assemblies  at  each  base.  The  optimal  allocation  of  the  N 
assemblies  among  the  bases  and  depot—  which  corresponds  to  the  second  portion  of  the  above 
problem—  is  obtained  from  the  expected  delay  in  assembly  repair  time  at  each  maintenance 
center. 

Suppose  U A C — c/V  dollars  are  available  for  investment  in  components.  How  should  it 
be  allocated  among  the  m components?  Clearly,  we  should  make  the  investment  so  that  the 
total  of  expected  customer  backorders  for  assemblies  is  reduced  by  the  greatest  amount.  If  all 
a,  Consolidated  Support  Families  are  identical,  it  is  not  hard  to  show  that  this  corresponds  to 
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an  allocation  in  which  the  stock  levels  are  selected  so  that  total  weighted  expected  delay  in 
assembly  repair  due  to  components  is  minimized,  where  the  weights  reflect  the  expected 
number  of  daily  assembly  failures  repaired  at  a maintenance  center.  Although  it  is  only  an 
approximation  in  cases  where  the  Consolidated  Support  Families  are  not  identical,  we  will  use 
this  objective  to  determine  the  allocation  of  the  available  U dollars  among  the  components  for 
each  subproblem.  A considerable  amount  of  experimentation  was  done  by  the  Air  Force  Logis- 
tics Command  using  this  type  of  approximation  in  the  MOD-METRIC  model  [4J.  The  approxi- 
mation produced  the  optimal  allocation  in  all  cases.  Thus,  the  component  stock  levels  in  the 
Q + 1 subproblems  are  obtained  by  solving  the  following  problem,  called  Problem  PI: 

(P 1)  min  £ r^G^-min  £ £ £ (x  - slk)p(x\k,kTlk) 

k € Af  k € N i x > 

m " | J 

subject  to  £ c,jy0  + £ c,s,J  < V , 

/-i  *-i  | 

where  s„  is  a nonnegative  integer. 


Observe  that  minimizing  the  total  weighted  expected  delay  due  to  components  is  equivalent  to 
minimizing  total  component  backorders.  The  solution  to  this  two-echelon  component  problem 
can  be  easily  obtained  using  the  method  described  in  either  Ref.  3 or  Ref.  5. 

When  the  component  stock  tevels  have  been  established,  we  must  then  determine  the 
optimal  method  for  allocating  the  N assemblies  among  the  depot  and  bases.  In  particular,  we 
must  solve  thg,  following  problem,  called  Problem  P2: 

(PD  min  £ £ (x  - st)p(x\\'jTj)  + £ k'kT'k 

it  M x>st  ktN 

subject  to  £ s,  « N . 

(-0 

where  s,  is  a nonnegative  integer. 


Due  to  the  interaction  of  stock  levels  among  echelons.  Problem  P2  is  neither  convex  nor  separ- 
able. We  therefore  employ  a simple  partitioning  procedure  to  obtain  its  solution.  The  algo- 
rithm for  solving  this  three-echelon  problem  is  based  on  the  system’s  nested-tree  structure,  as 
displayed  earlier  in  Figure  1.  The  algorithm  works  up  the  tree  by  solving  a sequence  of 
independent  two-echelon  subproblems,  one  set  of  problems  for  each  Consolidated  Support 
Family;  the  solutions  to  these  problems  are  then  combined  in  an  appropriate  way  to  solve  Prob- 
lem P2.  We  now  discuss  the  algorithm  for  solving  Problem  PI  in  detail. 

Suppose  the  depot  stock  level  is  fixed  at  Sq,  and  assume  that  a total  of  Nk  assemblies  are 
available  for  allocation  to  all  bases  in  Consolidated  Support  Family  k.  Then  the  optimal  alloca- 
tion of  the  Nk  assemblies  among  the  bases  can  be  found  by  solving  the  following  problem, 
called  Problem  P3: 

(Pi)  Bk(Nk;s0)  £ min  A'*  T*  + £ £ (jc  - Sj)p(x\X'jTj) 

JtN(k)  x > Sj 

subject  to  s0  fixed, 

£ J/  + s*  - Nk  .and 
i*N(k) 

s;  a nonnegative  integer,  J € N(k),  sk  € Rk  , 


{ 
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where  Rk  represents  a set  whose  elements  are  the  candidate  values  for  sk.  This  problem  may 
not  be  convex  and  is  not  separable.  To  obtain  its  solution  we  solve  the  subproblems 

h(sk  s0)  Amin  £ I (x  - sy)p(x|X; 7}) 

j(N(k)  x>Sj 

subject  to  s0and  sk  fixed, 

£ Sj  — Nk  - sk  , and 

jtNik) 

Sj  a nonnegative  integer. 


via  marginal  analysis  (valid  because  of  the  convexity  of  the  objective  function).  Then  the  solu- 
tion to  Problem  P3  is  found  by  solving 

min  h(sk,S()  + X' kT‘ k . 

sk*RK 

Since  the  optimal  value  of  Nk  is  unknown,  Problem  P3  is  solved  for  all  values  of  Nk  € Rk, 
where  Rk  represents  the  set  of  possible  total  family  k stock  levels. 

To  solve  Problem  P2  we  use  the  solutions  obtained  for  each  Consolidated  Support  Family. 
More  specifically,  to  solve  P2  we  solve  Problem  P4: 

(P4)  B(N)  Amin  £ Bk(Nk\s0) 

*— 1 

"i  _ _ 

subject  to  ]£  Nk  + s0  - N , 

*-i 

^k  € Rk,  Sq  € R o . 

where  R 0 represents  the  set  of  candidate  depot  assembly  stock  levels.  A dynamic  programming 
algorithm  is  used  to  compute  the  optimal  solution. 


The  amount  of  effort  required  to  solve  Problems  P3  and  P4  depends  on  the  cardinality  of 
the  sets  R0,  Rk,  and  Rk.  Fortunately,  the  number  of  stock  levels  that  need  to  be  explicitly 
considered  for  any  location  or  Consolidated  Support  Family  is  generally  not  large.  This  is  chiefly 
due  to  the  nature  of  the  functions  H(s<)  and  Hk(sk ),  which  rise  very  sharply  for  stock  levels 
below  the  mean  demand,  and  approach  0 rapidly  for  stock  levels  above  the  mean.*  Experiments 
(4]  on  similar  problems  indicate  that  the  cardinality  of  the  R0  and  Rk  sets  should  rarely  exceed 
10. 

To  find  Rk,  we  may  first  compute  the  total  expected  daily  removals  for  family  k , call  it  X*. 
An  estimate  of  the  average  family  k resupply  time  fk  is  found  by  weighting  the  expected  resup- 
ply times  for  each  location  in  the  family  by  the  proportion  of  family  k daily  demand  occurring 
at  that  location  and  then  summing  these  quantities  over  locations.  An  estimate  of  the  depot 
and  base  k optimal  stock  levels  obtained,  for  example,  using  the  method  described  in  Ref.  5,  is 
employed  to  estimate  the  value  of  T,  and  Tk  used  in  the  averaging.  Using  these  values,  we 
solve  Problem  P5: 


•An  illustration  of  this  fact  is  given  in  Ref.  4,  p.  479. 
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min  £ £ (x  - sk)p(x\\k  Tk) 


X>S* 


subject  to  £ sk  - N - s0,  and 

*-i 

sk  is  a nonnegative  integer, 

where  s0  <s  the  estimate  of  the  optimal  depot  stock  level.  Marginal  analysis  is  used  to  obtain 
the  optimal  solution,  since  the  objective^  function  is  convex.  Rk  is  constructed  based  on  the 
estimate  sk.  The  minimum  element  of  Rk  can  be  set  at  max{as*,  sk  — b)  and  the  largest  value 
at  min{c5fc,$*  + d).  The  values  of  a,  b,  c,  and  d can  be  selected  as  a function  of  the  size  of  sk. 
For  larger  values  of  Ik,  the  range  should  be  larger.  Limited  computational  experience  on  a 
similar  problem  using  this  technique  has  shown  that  a maximum  cardinality  of  IS  for  Rk  is  ade- 
quate [6].  However,  the  best  method  for  determining  R o,  Rk,  and  Rk  remains  an  open  ques- 
tion. 

Combining  the  above  observations,  we  can  state  a basic  algorithm  for  determining  item 
stock  levels: 

INITIALIZATION  STEP:  Establish  upper-  and  lower-bound  constraints  on  assembly 
investment.  Let  u and  / represent  these  upper  and  lower  limits  and  let  z'  represent  the  best 
known  objective  function  value.  Set  z'  - °o  and  U - C - I.  Assume  C is  an  integer  multiple 
of  c. 

STEP  1:  Solve  Problem  P6: 

(P6)  min  £ rk\kGk 


subject  to  £ c(s,o  + £ c,s ,*  < U , 

<-i  l *-i  | 

where  s,k  is  a nonnegative  integer. 


STEP  2:  Solve  Problem  P7: 


min  z - £ A'*r*+  £ { £ (x-sy)/»(x|\';7}) 


*-l  JfM  JjT>Jy 

n 

subject  to  £ cs,  - C - U , 

/-0 

where  and  T\  are  calculated  using  the  stock  levels  computed  in  Step  1,  and 
s,  is  a nonnegative  integer. 

STEP  3:  If  z ^ z\  go  to  Step  4;  otherwise,  set  z'  — z and  retain  the  corresponding  stock 
levels  as  the  incumbent  stock  levels.  Go  to  Step  4. 


STEP  4:  Decrement  i/by  c.  If  C — U > u,  stop;  otherwise,  return  to  Step  1. 
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The  algorithm  outlined  above  suggests  a rather  tedious  method  for  establishing  the 
optimal  investment  level  in  assemblies  and  components.  We  will  now  see  that  the  number  of 
assembly  budgets  that  need  to  be  explicitly  examined  is  generally  quite  small.  First  observe 
that  when  values  or  u and  / are  selected  one  should  consider  the  marginal  impact  of  investment 
in  components  on  expected  backorders  for  customer  demands  for  assemblies.  The  marginal 
impact  is  negligible  when  investment  in  components  is  large;  on  the  other  hand,  assembly  res- 
upply times  are  increased  substantially,  thereby  increasing  total  assembly  system  backorders, 
when  the  investment  in  components  is  relatively  low.  Roughly  stated,  we  would  like  to  allocate 
the  available  budget  C in  such  a way  that  the  marginal  reduction  in  backorders  for  customer 
demands  for  assemblies  per  dollar  invested  in  components  equals  the  marginal  reduction  per 
dollar  invested  in  the  assembly.  The  values  of  wand  /should  reflect  this  goal. 

It  is  easy  to  obtain  an  estimate  of  the  optimal  total  component  investment.  Suppose  we 
estimate  component  and  assembly  depot  stock  levels,  perhaps  using  the  method  described  in 
Ref.  5.  The  total  cost  of  this  investment  can  be  determined  and  subtracted  from  the  available 
budget  C.  We  next  assume  that  all  of  the  n,  Consolidated  Support  Families  have  the  same 
demand  rates  for  assemblies  and  the  same  number  of  operating  bases  and  that  all  demand  for 
assemblies  takes  place  at  the  corresponding  base  collocated  with  a maintenance  center.  Then  a 
crude  estimate  of  the  optimal  investment  in  components  for  each  k € A/  corresponds  to  the 
investment  level  for  which  the  partial  derivative  of  maintenance  center  Ar’s  average  resupply 
time  with  respect  to  dollar  investment  in  components  at  the  maintenance  center  k equals  1/c. 
We  can  then  easily  estimate  the  optimal  total  system  investment  in  components  by  multiplying 
the  Consolidated  Support  Family  estimate  by  and  adding  to  this  value  the  estimated  required 
depot  component  investment. 

Once  u and  / have  been  established,  we  simplify  the  search  for  the  optimal  partitioning  of 
the  budget  by  exploiting  the  apparent  strict  quasi-convexity  of  the  total  expected  customer 
backorders  for  assemblies  as  a function  of  investment  in  assemblies.  Using  the  Fibonacci 
search  algorithm,  we  see  that  it  is  necessary  to  examine  only  a very  small  number  of  assembly 
investment  levels  explicity.  For  example,  if  Q — 600,  only  13  problems  need  to  be  solved 
explicitly.  Each  problem  requires  the  solution  of  two  subproblems.  The  first  subproblem  has 
the  form  of  Problem  P6  in  Step  1 of  the  algorithm,  and  the  second  subproblem  has  the  form  of 
Problem  P7  in  Step  2.  The  value  of  V,  of  course,  corresponds  to  a specific  total  investment  in 
assemblies. 

Figure  2 displays  the  results  of  applying  the  proposed  algorithm  to  one 
assembly /component  family  for  the  Air  Force’s  F-15  aircraft.  The  graph  relates  total  expected 
customer  backorders  for  assemblies  to  the  proportion  of  the  total  system  budget  invested  in 
assemblies.  As  indicated  on  the  graph,  approximately  two-thirds  of  the  total  budget  should  be 
allocated  to  the  assembly.  Investing  either  a greater  or  lesser  proportion  of  the  total  budget  in 
the  assembly  increases  total  backorders.  A substantial  misallocation  of  the  available  budget  can 
seriously  degrade  system  performance.  For  example,  investing  one-half  rather  than  two-thirds 
of  the  budget  in  the  assembly  causes  expected  customer  backorders  for  assemblies  to  double. 

IV.  MULTIPLE-ASSEMBLY  PROBLEMS 

We  have  developed  a model  of  a three-echelon  inventory  system  for  one  assembly  type 
and  its  subordinate  components.  If  this  model  could  not  be  easily  extended  to  multiple- 
assembly  problems,  it  would  be  of  little  practical  use.  We  now  demonstrate  how  it  can  be 
extended. 
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Percentage  of  total  investment  allocated  to  assemblies 

Figure  2.  Sysiem  backorders  for  assemblies  as  a'funclion  of  the 
percentage  of  total  budget  allocated  to  assemblies 


In  practice,  Problem  P is  solved  for  a finite  number  of  budgets  Cj.Q,  ....  C'v  for  each 
assembly  family  i.  The  number  of  budgets  explicitly  examined  q,  depends,  in  practice,  on  the 
expected  assembly  failure  rate.  Using  the  data  obtained  when  solving  these  q,  problems,  it  is 
possible  to  plot  performance  vs  investment.  Figure  3 illustrates  this  trade-ofT  data  for  one  F-13 
assembly  family.  A piecewise  linear  function  can  then  be  constructed  to  approximate  the  entire 
performance-vs-investment  trade-off  curve  for  this  assembly  family,  as  shown  in  Figure  4.  If 
this  curve  is  not  convex,  then  replace  it  by  its  greatest  convex  minorant. 


After  the  convex  performance/investment  trade-ofT  curves  are  developed  for  each  assem- 
bly family,  they  are  combined  to  produce  a curve  relating  total  customer  backorders  for  all 
types  of  assemblies  as  a function  of  investment  in  all  assembly  and  component  types.  This 
curve  is  constructed  by  applying  a simple  marginal  analysis  algorithm.  The  first  point  on  the 
system-performance  curve  corresponds  to  the  total  expected  customer  backorders  for  an  assem- 
bly type  i when  the  minimal  amount  C{  is  invested  in  assembly  family  /. 


Let  B,(C/0  represent  the  total  expected  customer  backorders  for  assembly  /,  given  the 
investment  in  assembly  family  / is  C\.  Then  the  first  point  on  the  system-performance  curve  is 
£ B,(C\ ),  corresponding  to  an  investment  of  £ Cj.  Next,  compute 

/ i 


A | A 


B,(C |)  - B,(C'2) 
C'l  - c\ 


for  each  assembly  family.  Then  A/  measures  the  marginal  reduction  in  system  customer 
backorders  for  assemblies  per  dollar  invested  in  assembly  family  i.  Suppose  A*  — max  A/. 
Then  the  second  point  on  the  curve  is  ]£  fl,(C{)  - (Bk(C *)  - iMC*)),  corresponding  to  an 

__  i 

investment  of  £ Cj  + Cj  - C*.  Now  compute 


t 


A2* 


ZMCj)  - Bk(C}) 
Cl  - CJ 


ipected  assembly  system  backorders 
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and  find  the  minimum  of  A/ , A2 Aj1.  ....A/,  where  / represents  the  number  of  assembly 

families  in  the  problem.  The  third  data  point  is  determined  by  computing  the  new  total 
backorders  and  new  total  investment.  Continue  in  this  manner  until  all  the  available  individual 
assembly  family  data  have  been  used. 

We  illustrate  the  algorithm  with  a two-assembly  family  example.  Table  1 shows  the 
results  of  solving  Problem  P several  times  for  each  of  the  two  families.  In  particular,  the  data 
in  the  table  represents  the  investment-vs-backorder  data  for  each  individual  family.  Table  2 
contains  the  values  of  the  marginal  reduction  in  backorders  per  dollar  invested  for  each  incre- 
mental investment  level  for  each  assembly.  These  values  are  denoted  Aj,  where 

, b,(c;)  - g,(c;+, ) 

' " cj+ , - cj 

The  results  of  applying  the  algorithm  to  this  two-assembly  example  are  given  in  Table  3.  These 
data  show  how  system  performance— total  customer  backorders  for  assemblies— depends  on 
system  investment. 


TABLE  1.  Data  for  Two  F-15  Assembly  Families 


Assembly  Family  1 

Assembly  Family  2 

Budget  ($) 

Assembly 

Backorders 

Budget  ($) 

Assembly 

Backorders 

231,804 

0.1747 

1,036,100 

0.8580 

251,204 

0.1108 

1,168,100 

0.6018 

270,604 

0.0736 

1,300,100 

0.3642 

290,004 

0.0448 

1,432,100 

0.2415 

309,404 

0.0303 

1,564,100 

0.1465 

328,804 

0.0178 

1,682,400 

0.0878 

350,530 

0.0114 

1,814,400 

0.0531 

367,604 

0.0069 

— 

— 

TABLE  2.  Reduction  in  Backorders  per 
Dollar  Invested  for  Each  Increment 
in  Investment  for  Each  Assembly 


Assembly  Family  1 

Assembly  Family  2 

A,'  - 3.2938  x ir6 
Aj  - 1.9175  x 10"6 
Aj  - 1.4845  x 10-6 
Aj  - 7.4742  x 10"7 
Aj  - 6.4432  x 10"7 
Aj  - 2.9457  x 10-7 
Aj  - 2.6355  x 10“7 

A,2  - 1.9409  x 10"6 
Aj  - 1.8000  x 10“6 
Aj  - 9.2955  x 10~7 
A42  - 7.1970  x 10~7 
As2  - 4.9619  x 10~7 
Aj  - 2.6288  x 10~7 
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TABLE  3.  Backorder  and  Investment 
Data  for  the  Combined  System 
(Two  Assembly  Familes) 


Investment  ($) 

Backorders 

1,267,904 

1.0327 

1,287,304 

0.9688 

1,419,304 

0.7126 

1,438,704 

0.6754 

1,570,704 

0.4378 

1,590,104 

0.4090 

1,722,104 

0.2863 

1,741,504 

0.2718 

1,873,504 

0.1768 

1,892,904 

0.1643 

2,011,204 

0.1056 

2,032,930 

0.0992 

2,050,004 

0.0947 

2,182,004 

0.0600 

These  data  can  then  be  used  to  determine  what  the  individual  assembly-family  investment 
levels  should  be  so  that  a target  system  budget  or  performance  goal  is  achieved.  For  example, 
suppose  planners  decide  that  approximately  $1.9  million  is  available  for  investment  in  these  two 
assembly  families.  The  closest  tabulated  value  corresponds  to  a total  investment  of  $1,892,904. 
This  point  in  turn  corresponds  to  an  investment  of  $328,804  in  the  first  assembly  family  and  an 
investment  of  $1,S64,100  in  the  second  assembly  family. 

The  tabulated  values  can  be  used  in  a second  way  as  well.  Suppose  the  planners  decide 
they  want  no  more  than  0. 1 expected  customer  backorders  attributed  to  these  two  assemblies  at 
any  point  in  time.  Then  a budget  of  $2,032,930  must  be  made  available  for  these  assembly 
families,  with  $350,S30  and  $1,682,400  budgeted  for  the  first  and  second  families,  respectively. 

V.  AN  EXAMPLE  OF  ANALYSIS  USING  THE  MODEL 

As  we  have  mentioned,  the  main  reason  for  developing  the  model  described  in  this  paper 
was  to  assess  the  impact  on  inventory  investment  in  recoverable  spares  of  changing  the  Air 
Force’s  current  logistics-system  structure.  To  illustrate  the  use  of  the  model  in  this  regard,  we 
postulated  an  operating  environment  involving  three  bases.  In  this  example,  aircraft 
correspond  to  customers.  We  assume  there  are  two  squadrons  of  F-15  aircraft  stationed  in  the 
first  base;  one  squadron  of  F-15  aircraft  is  stationed  in  each  of  the  other  two  bases.  Flying 
activities  per  aircraft  are  assumed  to  be  the  same  at  each  of  the  three  bases.  A maintenance 
center  is  assumed  to  exist  at  each  base.  The  average  repair-cycle  time  is  assumed  to  be  4 days, 
order  and  shipping  time  from  the  depot  to  each  of  the  bases  is  12  days,  and  the  depot  repair- 
cycle  time  is  52  days  for  assemblies. 

We  selected  18  high-demand  assemblies  related  to  the  F-15  avionics  system  as  our  data 
base.  There  are  224  components  associated  with  these  18  assemblies.  For  these  assemblies, 
80%  to  95%  of  the  malfunctioning  items  can  be  repaired  at  the  maintenance  center  at  the  base. 
These  avionics-type  items  were  selected  for  analysis  because  it  would  make  sense  in  the  real 
world  to  consolidate  their  maintenance  at  some  central  location. 
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We  made  five  sets  of  computer  runs,  and  for  each  run  we  generated  a trade-off  curve 
between  inventory  investment  and  performance  expressed  in  terms  of  the  expected  number  of 
backorders  on  assemblies  at  the  three  bases: 

CASE  l is  the  base  case  in  which  the  structure  of  the  logistics  system  remains  the  same  as 
the  current  one.  In  other  words,  maintenance  is  performed  at  maintenance  centers  at  each 
location,  and  other  system  parameters  are  the  same  as  those  described  above. 

In  CASE  2 it  is  assumed  that  repairs  will  be  performed  at  the  largest  base,  namely  Base  1. 
Thus  Base  I has  a maintenance  center  and  Bases  2 and  3 do  not.  It  is  assumed  to  take  an  aver- 
age of  4 days  to  ship  defective  assemblies  to  Base  I from  Bases  2 and  3 and  to  ship  serviceables 
back  from  Base  1 to  Bases  2 and  3.  Shipping  time  from  Base  1 to  the  depot  and  depot  repair 
times  remain  the  same  as  in  the  base  case 

In  CASE  3 all  parameters  remain  unchanged  from  Case  2,  except  that  it  is  assumed  that 
the  proportion  of  repairs  that  cannot  be  accomplished  at  the  maintenance  center  for  every 
assembly  has  been  reduced  by  50%.  The  reduction  of  50%  is  hypothetical  and  is  not  based  on 
any  engineering  study.  Under  this  structure,  however,  the  Air  Force  has  in  some  actual  tests 
reduced  the  proportion  of  items  that  have  to  be  returned  to  the  depot  for  repair  by  roughly  this 
amount. 

In  CASE  4 we  based  our  calculation  on  the  same  proportion  of  failures  being  repaired  at 
the  depot  as  in  the  base  case  and  also  used  the  same  system  parameters,  except  the  shipping 
time  to  Base  1 from  Bases  2 and  3 has  been  reduced  from  4 to  2 days.  This  was  done  to  check 
the  effect  of  the  responsiveness  of  the  transportation  system  on  this  alternative  type  of  struc- 
ture. 

Finally,  in  CASE  5 we  assume  that  the  shipping  time  can  be  set  at  2 days,  and  it  takes 
only  2 days  to  ship  to  the  maintenance  center.  Furthermore,  we  assume  that  the  proportion  of 
repairs  that  cannot  be  accomplished  at  the  maintenance  center  has  been  reduced,  as  in  Case  3. 

The  results  are  shown  in  Figure  5.  Each  curve  summarizes  the  analysis  corresponding  to 
each  of  the  five  cases  described  above.  Each  curve  portrays  the  impact  on  the  performance  of 
the  support  system  as  a function  of  investment  in  inventory  of  spares  and  conditioned  on  sys- 
tem parameters,  as  described  above.  The  performance  is  stated  in  terms  of  the  number  of 
assembly  backorders  throughout  the  system.  For  example,  if  we  take  the  base-case  trade-off 
curve,  we  see  that  for  an  investment  of  $45  million,  there  will  be  9 backorders  on  the  average. 

A comparison  of  Case  2 with  the  base  case  shows  that  introducing  a change  in  the  logis- 
tics structure  of  the  type  described  would  imply  that  additional  spares  requirements  of  nearly  $5 
million  would  be  needed  to  maintain  the  same  level  of  performance.  However,  Case  3 results 
show  that  if  the  maintenance  capability  at  the  intermediate  level  could  be  enhanced  to  the 
extent  that  a greater  proportion  of  defective  assemblies  could  be  fixed  at  the  maintenance 
center,  instead  of  having  to  be  shipped  to  the  depot,  additional  spares  requirements  would  be 
minimal.  Even  without  the  assumed  improvement  in  the  maintenance  productivity,  if  it  takes 
only  2 days  to  ship  serviceable  and  broken  assemblies  from  operating  bases  to  the  maintenance 
center,  then  the  alternative  structure  does  not  require  any  additional  spares  investment,  as  dep- 
icted in  the  comparison  between  Case  1 and  Case  4.  It  was  mentioned  earlier  that,  in  the  alter- 
native structure,  an  additional  requirement  for  assemblies  may  be  offset  by  a reduction  in  com- 
ponent stockage.  When  Case  4 was  compared'to  Case  1 at  a performance  level  of  25  assembly 
backorders,  it  was  found  that  the  composition  of  stockage  had  changed  as  follows:  For  Case  1, 
inventory  investment  for  components  was  $13.8  million,  and  for  the  assemblies,  $27.5  million. 
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Figure  5.  Analysis  of  siruciurcs:  maintenance  cenirali/.aiion  vs  decentralization 


For  Case  4,  they  were  $11.3  million  and  $28.4  million,  respectively.  Thus,  under  the 
hypothesized  operating  conditions,  a saving  in  component  stockage  investment  more  than  offset 
a need  for  more  assemblies. 

Finally,  Case  5 suggests  that  if  the  alternative  three-echelon  structure  can  improve 
maintenance  productivity  as  well  as  rely  on  a highly  responsive  transportation  system,  economic 
gains  in  the  area  of  spares  requirements  are  possible. 
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VI.  SUMMARY  AND  CONCLUDING  COMMENTS 

A three-echelon,  two-indentured  inventory  model  was  developed  that  can  be  used  to 
establish  assembly  and  component  stock  levels  for  an  arbitrary  number  of  assembly  families. 
The  model's  development  was  based  on  a demonstration  of  how  assembly  and  component  stock 
levels  influence  the  average-resupply-time  equations  and,  ultimately,  the  expected  customer 
backorders  outstanding  at  any  time  at  any  location  for  assemblies.  Furthermore,  an  algorithm 
was  presented  for  computing  item  stock  levels  for  each  location. 

The  model  has  been  compared  with  two  other  approaches,  the  Air  Force's  initial  provi- 
sioning technique  [1]  and  a METRIC-like  optimization  model. 

The  Air  Force  initial  provisioning  technique  is  not  an  optimization  model.  Requirements 
are  established  by  determining  the  quantity  of  each  item  needed  to  fill  the  steady-state 
resupply-system  pipeline.  Neither  cost  nor  the  assembly/component  interactions  are  considered 
in  this  approach.  Normally,  too  large  a fraction  of  total  investment  is  allocated  to  assemblies 
when  this  approach  is  used.  The  second  approach  is  an  optimization  model,  whose  objective  is 
to  minimize  total  assembly  and  component  backorders,  subject  to  a constraint  on  total  inven- 
tory investment.  However,  the  assembly  /component  relationship  is  not  considered.  The  model 
usually  allocates  too  large  a proportion  of  a given  budget  to  components,  because  they  are  gen- 
erally less  expensive  than  assemblies,  and  both  assembly  and  component  backorders  are  con- 
sidered to  be  equally  undesirable  in  the  model.  The  assumptions  upon  which  this  model  is 
developed  are  the  same  as  assumptions  (1)  through  (7)  in  Section  II.  To  illustrate  these  obser- 
vations, the  two  alternate  approaches  were  compared  with  the  proposed  model.  For  a set  of  F- 
15  fire-control-system  data,  aircraft-related  assembly  backorders  more  than  doubled  when  the 
two  alternate  approaches  were  used.  The  same  total  target  budget  was,  of  course,  used  in  all 
cases.  As  this  test  indicates,  ignoring  the  hierarchical  relationship  between  the  assemblies  and 
its  components  can  degrade  expected  system  performance  substantially  for  a given  level  of 
investment.  Stated  in  another  way,  ignoring  this  relationship  causes  an  overinvestment  in 
spares  to  achieve  a specific  system-performance  goal. 

Ostensibly,  the  model's  main  use  would  be  to  determine  inventory  levels  for  each  loca- 
tion. The  model,  however,  was  developed  primarily  as  a tool  for  investigating  the  impact  on 
both  supply  performance  and  investment  of  changing  the  Air  Force’s  two-echelon  supply  sys- 
tem to  a three-echelon  system.  Specifically,  Air  Force  planners  are  interested  in  examining 
how  such  a change  affects  the  requirement  for  logistics  resources,  and  inventory  investment  in 
particular.  Thus,  in  addition  to  being  simply  a mechanism  for  computing  stock  levels,  the 
model  can  be  effectively  employed  to  answer  many  questions  related  to  the  design  of  a logistics 
system.  For  example,  issues  that  can  be  addressed  include  the  number  and  siting  of  mainte- 
nance centers,  the  impact  of  changing  pipeline  times  on  inventory  investment,  and  the  way  that 
repair  capability— measured  in  the  model  in  terms  of  the  probability  that  an  item  is  repaired  at  a 
particular  location— alters  the  investment  in  inventory. 
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ABSTRACT 

A melhod  of  life  testing  is  proposed  which  combines  both  ordinary  and  ac- 
celerated life-testing  procedures.  It  is  assumed  that  an  item  can  be  tested  either 
in  a standard  environment  or  under  stress.  The  amount  of  stress  is  fixed  in  ad- 
vance and  is  the  same  for  all  items  to  be  tested.  However,  the  time  cat  which 
an  item  on  lest  is  taken  out  of  the  standard  environment  and  put  under  stress 
can  be  chosen  by  the  experimenter  subject  to  a given  cost  structure  When  an 
item  is  put  under  stress  its  lifetime  is  changed  by  the  factor  a.  Let  the  random 
variable  T denote  the  lifetime  of  an  item  in  the  standard  environment,  and  let 
Y denote  its  lifetime  under  the  partially  accelerated  test  procedure  just 
described.  Then  Y - T if  T < jr,  and  Y - x + « (T  - x)  if  T > x.  It  is  as- 
sumed that  7"  has  an  exponential  distribution  with  parameter  it  The  estimation 
of  H and  a and  the  optimal  design  of  a partially  accelerated  life  lest  are  studied 
in  the  framework  of  Bayesian  decision  theory. 


1.  INTRODUCTION 

In  many  problems  of  life  testing,  the  experimenter  realizes  that  the  test  process  may 
require  an  unacceptably  long  time  period  for  its  completion  if  the  test  is  simply  carried  out 
under  specified  standard  stress  conditions.  In  such  problems,  the  experimenter  is  generally  able 
to  run  the  life  test  under  stresses  that  are  higher  than  the  specified  standard  in  order  to 
accelerate  the  process  and  shorten  the  time  to  its  completion.  Furthermore,  he  can  either  start 
the  life  test  under  these  higher  stresses  and  continue  the  test  under  these  conditions  to  comple- 
tion, or  he  can  start  the  test  under  the  standard  conditions  and  only  apply  the  higher  stresses  if 
the  test  is  not  completed  by  some  specified  time. 

This  type  of  problem  does  not  seem  to  have  been  treated  in  the  literature  on  life  testing 
or  accelerated  life  testing,  where  it  is  usually  assumed  that  the  experimenter  can  control  the 
levels  of  higher  stress  to  be  used  in  the  test.  However,  it  is  also  assumed  that  the  entire  test 
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must  be  carried  out  at  this  fixed  higher  level.  Some  of  the  standard  work  in  this  area  will  now 
be  described  briefly. 

Epstein  [4]  has  presented  life-testing  problems  in  which  a number  of  items  are  put  on  test 
and  the  testing  process  is  carried  out  for  some  period  of  time  and  then  terminated  in  accor- 
dance with  some  specified  stopping  rule.  The  lifetimes  of  different  items  are  assumed  to  be 
independent,  each  is  assumed  to  have  some  specified  distribution  function  (d.f.)  F(t,  0),  and 
inferences  about  the  parameter  0 are  to  be  made  on  the  basis  of  the  outcomes  of  the  testing 
process.  Problems  of  optimal  design  connected  with  this  life-testing  process  would  involve  the 
questions  of  how  many  items  to  put  on  test,  whether  or  not  to  replace  items  when  they  fail, 
and  how  to  specify  an  optimal  stopping  rule. 

Chernoff  [2]  and  Bessler  et  al.  [1]  introduced  and  studied  the  concept  of  accelerated  life 
tests.  In  these  tests,  the  parameter  0 , which  appears  in  the  d.f.  F(t.  0),  is  regarded  as  a 
specified  function  0 - < /i(s,  a)  of  an  environmental  stress  s,  to  which  an  item  on  test  can  be 
subjected,  and  an  unknown  parameter  a.  They  consider  problems  of  estimation  of  a and  of 
optimal  design  of  the  testing  process  in  both  sequential  and  nonsequential  contexts.  The  distri- 
bution of  life-times  is  assumed  to  be  exponential  and  the  function  0 is  usually  taken  to  be 
linear. 

Some  recent  references  on  accelerated  life  testing  are  Meeker  and  Nelson  [7],  which  con- 
siders Weibull  and  extreme- value  distributions,  and  Nelson  and  Kielpinski  (8],  which  considers 
censored  tests  for  normal  and  lognormal  distributions.  They  also  assume  that  the  function  0 is 
linear. 

As  previously  mentioned,  in  our  work  we  assume  that  the  experimenter  can  control  the 
time  at  which  a lest  item  is  switched  from  the  standard  stress  conditions  »o  higher  stresses.  In 
many  problems,  such  as  those  of  accelerated  life  testing,  it  will  also  be  possible  for  the  experi- 
menter to  choose  various  levels  of  higher  stresses.  For  simplicity,  in  this  paper  we  shall  restrict 
ourselves  to  problems  in  which  the  higher  level  of  stress  is  fixed  in  advance  and  is  the  same  for 
all  items  to  be  tested. 

Since  this  framework  combines  both  ordinary  and  accelerated  life-testing  procedures,  we 
will  call  it  partially  accelerated  life  testing. 

We  shall  denote  the  lifetime  of  an  item  tested  under  the  standard  conditions  by  the  ran- 
dom variable  T,  and  we  shall  let  F(t,  0)  denote  the  d.f.  of  T.  Here,  the  value  of  the  parameter 
0 is  unknown  and  is  to  be  estimated.  Suppose  that  if  the  item  has  not  failed  by  some  specified 
time  x,  then  it  is  switched  to  the  higher  level  of  stress  and  the  test  is  continued  until  the  item 
fails.  We  assume  that  the  effect  of  this  switch  is  to  multiply  the  remaining  lifetime  of  the  item 
by  some  unknown  factor  a > 0. 

In  general,  a will  be  a function  of  the  higher  stress  levels  that  are  chosen.  However, 
since  we  are  assuming  that  only  one  higher  stress  level  is  used,  a can  be  regarded  as  a constant. 
Furthermore,  since  the  effect  of  switching  to  the  higher  stress  level  will  typically  be  to  shorten 
the  life  of  the  test  item,  usually  a will  be  less  than  1. 

To  describe  the  model  for  this  partially  accelerated  life  test,  we  shall  let  Y denote  the  total 
lifetime  of  a test  item.  Thus,  Y is  defined  by  the  relation 

| T for  T ^ x. 

|x  + a(7'-x)  for  T > x. 


I 


(1.1) 


Y 
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Since  switching  to  the  higher  stress  level  can  be  regarded  as  tampering  with  the  ordinary  life 
test,  Y is  called  a tampered  random  variable , x is  called  the  tampering  point,  and  a is  called  the 
tampering  coefficient.  This  model  and  an  application  were  introduced  by  Goel  [5]. 

We  shall  assume  that  an  experimenter  starts  with  a sample  of  n items  and  subjects  them 
to  test  in  the  standard  environment.  If  item  / has  not  failed  by  some  prespecified  time  x,,  then 
it  is  put  under  the  higher  stress  and  the  test  is  continued.  If  T,  would  be  the  lifetime  of  item  / 
in  the  standard  environment,  then  the  total  lifetime  Y,  of  item  / under  this  partially  accelerated 
life  test  is  given  by  (1.1).  It  would  be  possible  to  consider  problems  in  which  the  tampering 
point  x,  for  item  / is  chosen  sequentially,  after  the  experimenter  has  observed  whether  or  not 
some  of  the  other  items  have  previously  failed,  but  we  shall  not  do  so  in  this  paper. 

The  statistical  problems  involved  in  using  the  model  (1.1)  are  (i)  the  estimation  of  9 and 
oi  for  given  values  of  the  tampering  points  x,,  ....  x„  and  (ii)  the  choice  of  an  optimal  design 
for  this  estimation,  i.e.,  the  selection  of  the  best  tampering  points. 

The  estimation  of  9 and  a based  on  tampered  random  variables  Y\,  ...  , Y„  correspond- 
■ ing  to  the  tampering  points  xif  ...  , xn,  which  may  or  may  not  be  distinct,  has  been  discussed 

by  Goel  [6].  In  that  paper,  the  consistency  and  asymptotic  normality  of  the  maximum  likeli- 
hood estimators  was  demonstrated  for  different  types  of  distributions  under  various  conditions 
on  the  tampering  points. 

We  shall  consider  the  estimation  problem  in  the  framework  of  Bayesian  decision  theory 
and  determine  the  optimal  design  for  various  loss  and  cost  structures.  The  discussion  in  this 
paper  is  restricted  to  cases  in  which  the  random  variable  T has  an  exponential  distribution  with 
parameter  9.  However,  the  results  on  optimal  design  will  be  valid  for  a somewhat  broader  class 
of  distributions. 


2.  TERMINOLOGY  AND  NOTATION 

The  following  terminology  and  notation  will  be  used  throughout  the  paper.  A sample  of  n 
observations  Yit  . . . , Y„  is  obtained  on  the  random  variable  Y corresponding  to  preassigned 

tampering  points  xi x„.  If  the  observed  value  y,  of  Y,  is  less  than  the  corresponding 

tampering  point  x„  then  Y,  is  called  an  untampered  observation.  Otherwise,  Y,  is  called  a tam- 
pered observation.  Thus,  an  untampered  observation  comes  from  a test  item  that  failed  under 
the  standard  conditions,  and  a tampered  observation  comes  from  a test  item  that  failed  after  it 
had  been  switched  to  the  higher-stress  level. 

* The  number  of  tampered  observations  among  Yt,  ...  , Y„  is  denoted  by  the  random  vari- 
able M.  Also,  we  shall  let  A denote  the  set  of  indices  / € { 1 n } for  which  Y,  is  a tampered 

observation  and  let  A denote  the  complementary  set  of  indices  corresponding  to  untampered 
j observations.  Thus,  A contains  M elements,  A contains  n - M elements,  Y,  > x,  for  / € A,  and 

Yj  < x,  for  j € A. 

Let  7t  ,(9)  denote  the  probability  that  the  / lh  test  item  will  be  tampered.  Then 
(2.1)  ir,(fl)  - Pr  (T,  > x,|0). 

It  is  convenient  to  introduce  independent  random  variables  {] {„  such  that  Pr({,  — 1)  — 

it ,(0)  and  Pr({,  - 0)  - 1 - nt( 9 ),  for  / - 1 n.  Then  the  conditional  distribution  of  M 
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given  9 is  identical  to  the  conditional  distribution  of  given  9.  Hence,  for  any  prior  distri- 

i 

bution  of  9,  the  prior  (predictive)  distribution  of  A 1 is  identical  to  the  marginal  distribution  of 

ft 

If, 


We  shall  now  present  a summary  of  the  results  obtained  in  this  paper.  In  Section  3 it  is 
assumed  that  Thas  an  exponential  distribution  with  the  following  p.d.f.: 


(2.2) 


/(/ 1«) 


9 exp  (-19)  for  t > 0, 
0 for  i ^ 0. 


[i 


It  is  assumed  that  the  joint  prior  distribution  of  9 and  a belongs  to  an  appropriate  conjugate 
family,  and  the  Bayes  estimators  of  9 and  a are  then  obtained  for  a particular  class  of  loss  func- 
tions. The  corresponding  Bayes  risks  are  given  in  a form  suitable  for  use  in  the  optimal  design 
problem. 

In  Section  4,  we  consider  the  optimal  design  problem  for  a general  class  of  risk  functions. 
First,  a random  cost  structure  is  assumed,  whereby  one  pays  a fixed  cost  for  each  tampered 
observation  and  another  fixed  cost  for  each  untampered  observation.  It  is  proved  that  for  this 
cost  structure  the  optimal  design  uses  only  two  different  tampering  points,  namely,  x — 0 and 
x - 00 . In  other  words,  some  observations  are  immediately  tampered,  and  the  rest  are  not 
tampered  at  all.  For  a wide  class  of  other  cost  functions,  the  optimal  design  is  shown  to  be  of 
the  same  structure.  The  paper  is  written  in  such  a way  that  a reader  who  is  interested  mainly  in 
the  optimal  design  problem  may  skip  Section  3 and  proceed  directly  to  Section  4. 

In  Section  5,  the  results  of  Section  4 are  applied  to  the  specific  estimation  problems  dis- 
cussed in  Section  3.  For  each  problem  the  optimal  solution  is  obtained  for  a class  of  cost  func- 
tions which  admit  a two-point  optimal  design.  Finally,  a cost  function,  for  which  the  optimal 
design  is  not  concentrated  on  two  points,  is  presented. 

3.  BAYES  ESTIMATION  FOR  EXPONENTIAL  DISTRIBUTIONS 

In  this  section  the  p.d.f.  of  the  random  variable  Tis  assumed  to  be  of  the  form  (2.2).  We 
first  assume  that  the  parameter  9 is  known,  say  9 - 0O,  and  we  want  to  estimate  the  unknown 
parameter  a.  We  will  then  use  these  results  for  the  case  in  which  9 is  unknown.  It  is  con- 
venient to  work  with  the  parameter  p - 1/a.  In  most  problems  of  partially  accelerated  life  test- 
ing p will  be  greater  than  1.  However,  in  order  not  to  restrict  the  applicability  of  this  model  we 
shall  consider  prior  distributions  for  p that  assign  positive  density  to  all  positive  values  of  p.  If 
the  experimenter  is  almost  certain  that  p > 1,  then  he  can  choose  a prior  distribution  of  the 
form  (3.1)  below  that  assigns  a suitably  small  probability  to  the  interval  0 < p < 1. 


We  shall  assume  that  the  prior  distribution  of  p is  a gamma  distribution  with  parameters  r 
and  s0o,  the  p.d.f.  of  which  is 


(3.1) 


[(s»o)7r(/-)) /3"-‘  exp(-s0o  p)  for  p >0, 
0 otherwise. 


i 


9 


Since  these  distributions  form  a conjugate  family  in  this  problem,  it  follows  that,  given  the 
values  of  ....  x„  and  y„,  the  posterior  distribution  of  p is  again  a gamma  distribu- 

tion with  parameters  r,  and  S|0O  (see  DeGroot  [3],  p.  166),  where 

(3.2)  r,  - m + r and  s,  - s + £0'-x,). 

if  A 


* 
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If  there  are  no  tampered  observations  in  the  sample,  then  we  obtain  no  information  about  the 
value  of  a and  the  posterior  distribution  of  a is  the  same  as  the  prior. 

Since  /3  is  a scale  parameter,  it  is  reasonable  to  consider  loss  functions  for  its  estimation 
that  are  invariant  under  changes  in  the  units  of  measurement  of  lifetimes.  The  following  two 
loss  functions  have  this  property: 

(3.3)  1,(0,  0)  — - lj  and  i2(0,  0)  - J-  - lj  . 

Each  of  these  loss  functions  measures  the  relative  squared  error  and  combines  the  standard 
squared-error  loss  with  the  invariance  requirement.  The  loss  function  Lx  measures  the  squared 
error  relative  to  the  actual  value  of  0,  and  L 2 measures  the  squared  error  relative  to  the  mag- 
nitude of  the  estimate  0. 

In  fact,  however,  we  shall  obtain  our  results  for  a wider  class  of  loss  functions  containing 
L\  and  12.  Specifically,  we  shall  assume  that  the  loss  function  is  of  the  form 

(3.4)  Up.  I 3) -0*0 '(0-/3) J. 

where  -2  < k <0  and  -oo  < / < oo.  It  should  be  noted  that  only  values  of  k in  the  interval 
-2  < A:  <0  are  of  interest,  because  the  Bayes  risk  is  infinite  for  k < -2  and  is  0 for  it  > 0. 
Furthermore,  if  Up,  p)  satisfies  (3.4)  and  we  let  a - 1/0,  then  L(0.  0)  - a*1  a^(a -a)2, 
where  k\  - -k-2  and  /,  - -1-2.  Again,  Ar  i will  lie  in  the  interval  -2  < Ac,  < 0.  Hence,  esti- 
mation of  p is  equivalent  to  estimation  of  a for  appropriate  values  k and  /.  The  loss  function  L 
reduces  to  L , when  k - 0 and  / - - 2,  and  to  L2  when  k - -2  and  / - 0. 


THEOREM  1:  For  r + / > 0,  the  Bayes  estimator  0 with  respect  to  the  loss  function  L is 
given  by 

(3.5)  0 = y*(T>,)  — j-, 

J1B0 

where  r,  and  s,  are  given  by  (3.2),  17,  - 8|  — rx  + /,  and  for  r>  > 0 the  function  yk  is  defined 
by 


k + 1 + 1 - k(k+2)  2 for  -2  < k < 0, 

*+ 2 v 


1 + — 


for  k — —2. 


The  Bayes  risk  p t,  for  given  tampering  points  xx,  , x„,  is 

r(r  + k + / + 2)  F Uri+l  + l) 

(3,7)  Pl"  r(r)(s0<)k+'+2  £w|r(r,  + / + *+2)  P(6"  ^ / 


'('iw 
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The  expectation  in  (3.7)  is  taken  with  respect  to  the  conditional  distribution  of  M given  9 — 9q, 
as  defined  in  Section  2,  with  n,(9j  - exp(-0ox,),  and  p( 8,  tj)  is  defined  as  follows  for  8 > 0 
and  t)  > 0: 


(3.8) 


p(8.  tj)  - 8*+‘[n(T,)]‘U  + [n(r,)  - l]2 

71 


PROOF:  It  follows  from  (3.4)  that  the  posterior  risk  for  any  estimator  0 is  given  by 
R (0)  - 0*+2  £(0 ')  - 20k+1  £(0,+1)  + 0*  £(0  ,+2). 


where  the  posterior  moments  of  0 are  given  by  E{p')  - Y(r{  + 0/  lT(r,)  (s,®^']  for 
r{  + I > 0.  For  -2  < k <0,  the  solution  0 of  the  equation  d/?(0)/30  - 0 that  minimizes 
£(0)  is  given  by  (3.5)  and  (3.6).  Hence,  0 is  the  Bayes  estimator.  It  follows  that  the  posterior 
Bayes  risk  can  be  written  as 


(3.9) 


£(0) 


r(r,  + / + l) 

r(r.)  (s,0 o)*+,+2 


P(®  |.r»|). 


The  Bayes  risk  p,  is  the  expectation  of  R (0)  with  respect  to  the  joint  marginal  distribution  of 

Y\.  ....  Y„.  However,  the  distribution  of  0,  given  X| x„  and  the  set  A,  is  the  same  as 

its  prior  distribution.  It  can  be  shown,  therefore,  that  the  p.d.f.  of  the  posterior  parameter 
given  xx,  , xn  and  the  set  A,  is 


/<*,) 


T(m+r)  , 
r(m)  T(r)  VSl 


s)m' 


sr 


for  s,  ^ s, 


and  /(i|)  - 0 otherwise.  Hence, 

(3.10)  £[sf(*+/+2)  \M~m\ 


r(r+k+l+2 ) r(m+r) 

T (r)  T(m+r+/+k+2)  ' 


It  follows  from  (3.9)  and  (3.10)  that  theTlayes  risk  p{  is  given  by  (3.7). 

It  is  noteworthy  that  90  does  not  appear  in  the  conditional  p.d.f.  f(s\). 

When  9 is  unknown,  a conjugate  family  of  joint  prior  distribution  for  0 and  9 can  be 
specified  as  follows: 

Given  9 - 0O,  the  conditional  prior  distribution  of  0 is  a gamma  distribution  with  parame- 
ters rand  s90,  and  the  prior  distribution  of  9 is  a gamma  distribution  with  parameters  r0  and  s0. 

It  follows  that,  given  the  observations  yn  and  the  values  of  x( x„  and  the 

set  A,  the  joint  posterior  distribution  of  0 and  9 can  be  specified  as  follows: 


Given  9 — 0O,  the  conditional*  posterior  distribution  of  9 is  a gamma  distribution  with 
parameters  r,  and  where  rt  and  s,  are  given  by  (3.2),  and  the  posterior  distribution  of  9 is 
a gamma  distribution  with  parameters  r2  and  s2,  where  r2  and  s2  are  defined  by 

(3.11)  r2  - r0  4-  n-m  and  s2  - s0  + £ x,  + £ Yt. 

l(A 
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If  all  the  observations  are  untampered,  then  m - 0,  s]  - s,  and  s2  - *0  + £ Y,.  If  *11  ihe 

i-t 

n n 

observations  are  tampered,  then  m - n,  S|  - s + £ ( K,  — x,),  and  s2  - So  + J,x,. 

<-i  <-i 

It  should  be  noted  that  this  posterior  distribution  does  not  depend  on  the  values  of  the 
tampering  points  corresponding  to  the  untampered  observations.  Hence,  it  does  not  depend  on 
the  method  by  which  these  points  were  chosen. 

We  will  consider  the  following  estimation  problems  in  the  remainder  of  this  section:  (i) 
the  estimation  of  9 only,  (ii)  the  estimation  of  0 only,  (iii)  the  estimation  of  both  0 and  9. 


Estimation  of  9:  It  is  assumed  that  the  loss  function  due  to  estimation  error  in  9 is  of  the  form 
L(9.  9)  - - 9)2.  with  -2  < k < 0.  Since  the  posterior  distribution  of  9 is  similar  to  the 

posterior  distribution  of  0 when  9 - 9^  the  Bayes  estimator  9 can  be  derived  by  methods  used 
in  Theorem  1 . Furthermore,  after  some  algebraic  manipulations,  the  posterior  risk  of  9 can  be 
written  as 

(3.12)  R(9)-  2 k+lT,  p(& 2.  *12), 

r (r2)  s? 

where  r2  and  s2  are  given  by  (3.11),  p(8,t))  is  given  by  (3.8),  and  82  ” V2  “ r2  + /.  If 
k + / + 2 ^ 0,  it  seems  impossible  to  integrate  (3.12)  with  respect  to  the  joint  marginal  distri- 
bution of  y\,  ....  y„.  However,  if  k+l  + 2-0,  the  posterior  risk  R(9)  is  a function  of  M 
only  and  the  expectation  of  (3.12)  reduces  to  a form  similar  to  (3.7).  It  should  be  noted  that 
the  loss  functions  L\  and  Li  in  (3.3)  satisfy  the  condition  k + / + 2 — 0.  The  following 
theorem  results  from  this  discussion: 


THEOREM  2:  If  r0  + / > 2,  then  the  Bayes  estimator  9 with  respect  to  the  loss  function 
L is  given  by 

(3.13)  o-yk(vi) 


If  k + / + 2 - 0,  then  the  Bayes  risk  is  given  by 

I T(r2  + 1 + 1) 


(3.14) 


P 2"  em 


r(r2) 


p(8j,  1J2) 


The  distribution  of  Ml  in  (3.14)  is  as  defined  in  Section  2,  with  it ,(9)  — exp(— 9x,)> 


i- 1,  ....  n. 


Estimation  of&:  The  next  result  gives  the  Bayes  estimator  0 and  the  corresponding  Bayes  risk. 

THEOREM  3:  For  r + / > 3 and  r0  > / + 2,  the  Bayes  estimator  0 with  respect  to  the 
loss  function  L is  given  by 

(3.15) 


& ~ "y k(Ti 3)  ® 3s 2/*  1 • 
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where 

(3.16) 


r\  + 1 

,nd 


(f!  + /)  (r2  - / - 2) 
Vi  + r2  - 1 


and  all  other  variables  are  as  previously  defined.  If  k + / + 2 - 0,  then  the  Bayes  risk  is  given 
by 


(3.17) 


„ r(r,  + / + l)r(r2  — / - 1)  % 

p 3 “ Em  T(rt)  nr)  • 


where  the  distribution  of  M is  as  given  in  Theorem  2. 


PROOF:  Since  the  / th  posterior  moment  of  /9  is  given  by 


(3.18) 


r(n')  r(r,+/)r(r2-/)  * ' 

(/n  r(r,)r(r2)  s,  ’ 


it  follows,  from  a discussion  similar  to  that  given  for  Theorem  1,  that  0 is  given  by  (3. IS). 
Furthermore,  the  posterior  Bayes  risk  can  be  written  as  a product  of  a function  of  M and 
(S]/s {)k+l+7.  If  k + / + 2 - 0,  expression  for  p3  follows  from  a discussion  similar  to  that  given 
for  Theorem  2. 


Estimation  of  /3  and  9:  We  shall  assume  that  the  loss  from  estimating  both  /9  and  0 is  a linear 
combination  of  the  losses  resulting  from  the  estimation  of  each  of  the  parameters  separately. 
Thus,  the  loss  function  is  given  by 

(3.19)  l(9,  fj;9,  /3)  - m'V1  0 - p)2  + AjflV2  ( 9 - 9)2, 

where  At  and  X2are  positive  constants. 

The  Bayes  estimators  9 and  /3  are  given  in  Theorems  2 and  3 with  the  appropriate  choices 
of  the  values  of  k and  /.  Furthermore,  if  k,  + /,  + 2 - 0 for  / - 1, 2,  then  the  Bayes  risk  is 
given  by  the  corresponding  linear  combination  of  p2  and  p3. 

The  foregoing  analysis  can  be  performed  for  other  loss  functions  and  different  distribu- 
tions of  the  random  variable  T.  In  particular,  when  T follows  a uniform  distribution,  the  analo- 
gous results  are  given  in  [S]. 

In  this  section  all  the  expressions  for  the  Bayes  risks  are  given  in  the  form  E[h(M)], 
where  the  function  h is  explicitly  known.  It  should  be  noted  that  it  is  difficult  to  find  the 
expectation  and  the  risk  as  an  explicit  function  of  ....  xn.  In  Section  4 we  shall  consider 
the  problem  of  choosing  optimal  designs  based  only  on  the  knowledge  of  the  function  h.  The 
results  obtained  will,  therefore,  be  applicable  to  other  distributions  of  the  random  variable  T as 
long  as  the  function  h is  known. 

4.  OPTIMAL  DESIGNS  FOR  ESTIMATION 

Suppose  now  that  the  experimenter  has  to  pay  a cost  for  each  item  tested.  In  general,  this 
cost  will  depend  on  the  tampering  point  x and  on  whether  or  not  the  observation  is  actually 
tampered.  Under  these  conditions,  the  experimenter  desires  to  choose  an  optimal  design  for 
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the  estimation  of  the  unknown  parameters,  i.e.,  to  choose  n tampering  points  xt,  ...  , x„  such 
that  the  total  risk  (the  sum  of  the  Bayes  risk  due  to  the  estimation  error  and  the  cost  of  choos- 
ing the  tampering  points)  is  a minimum.  In  general,  it  will  be  difficult  to  get  a closed  form 
solution  to  this  minimization  problem  unless  a simple  expression  for  the  Bayes  risk  is  available. 
In  accordance  with  the  results  in  Section  3,  we  shall  now  assume  that  this  risk  can  be  written  as 

(4.1)  p-E[h(M)  1, 

where  the  function  h is  explicitly  known  and  M is  the  number  of  tampered  observations.  We 
shall  show  that  the  optimal  design  problem  can  then  be  solved  for  a wide  class  of  cost  func- 
tions. 


The  results  to  be  presented  in  this  section  are  not  restricted  to  the  case  in  which  7”  has  an 
exponential  distribution  but  are  applicable  for  any  specified  family  of  continuous  distributions 
Fit,  9)  supported  on  the  nonnegative  part  of  the  real  line. 

Suppose,  first,  that  the  cost  of  any  observation  depends  only  on  whether  or  not  it  is  tam- 
pered and  not  in  any  other  way'  on  the  value  of  the  tampering  point  x We  shall  assume  that 
the  cost  of  an  observation  is  v j > 0 if  it  is  untampered  and  v2>  if  it  is  tampered.  This  cost 
structure  seems  to  be  valid  in  many  practical  problems.  Furthermore,  it  will  also  be  used  later 
in  this  section  as  a device  to  solve  optimal  design  problems  with  other  cost  functions.  There- 
fore, the  total  cost  of  the  observations  is  equal  to  nvx  + (i/2  — v^M,  and  we  must  minimize  the 
total  expected  risk 

(4.2)  Rq  — p 4-  (i>2  — »>i)  E(M)  + /ii/]  = E[h(M)  + (v2  — v\)M]  + 

Except  for  a constant,  the  risk  R0  in  (4.2)  is  the  expected  value  of  the  random  variable 

h(M)  + («/2  - v\)M.  Therefore,  among  all  possible  distributions  of  M,  it  is  minimized  when 
the  distribution  of  M assigns  probability  1 to  the  integer  m0  satisfying 

(4.3)  h(m^  + (i/2  - j>,)m0  - min  [/r(i)  + (i/2  — i/,)/]. 

0. 1 n 

This  degenerate  distribution  of  Mis  achieved  by  if  we  choose  m0  tampering  points  at  x — 0,  so 
that  these  observations  are  tampered  immediately,  and  the  remaining  n - m0  tampering  points 
at  x — «>,  so  that  these  observations  are  never  tampered.  Thus,  under  the  optimal  design  the 
experimenter  never  leaves  to  chance  whether  or  not  an  observation  will  be  tampered. 

The  cost  structure  we  have  just  considered  is  random  in  the  sense  that  the  cost  of  an 
observation  is  not  fixed  in  advance  but  depends  on  whether  or  not  the  observation  turns  out  to 
be  tampered.  We  shall  now  assume  that  the  cost  c(x)  of  each  observation  is  fixed  in  advance 

and  depends  only  on  the  tampering  point  x.  Now  for  the  optimal  design  we  need  to  choose  the 

tampering  points  x, x„  to  minimize 

(4.4)  K(x, x,)  - E[h(M))  + £c(x,). 

<-i 


For  any  given  tampering  point  x,  let 
(4.5)  p(x)  - £|Pr(r  > x|«)], 

where  the  expectation  is  evaluated  with  respect  to  the  given  prior  distribution  of  9.  In  other 
words,  p(x)  is  the  prior  probability  that  an  observation  will  be  tampered  when  the  tampering 

n 

point  xis  used.  It  follows  that  E(M)  — where  p,  - p(x,)  for  / — 1 n. 
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Under  the  assumptions  on  the  distribution  of  T made  at  the  beginning  of  this  section, 
p(x)  is  a strictly  decreasing  function  of  xfor  x > 0.  Therefore,  the  cost  function  c(x)  can  be 
written  as  a function  of  p,  rather  than  of  x,  which  we  denote  by  c*(p).  In  other  words,  c*(p) 
is  the  cost  of  choosing  a tampering  point  for  which  the  probability  is  p that  the  observation  will 
be  tampered. 


In  particular,  if  the  cost  function  c*is  of  the  form 

Co  O')  * P|  + (•'j  - v\)p, 

then  the  risk  defined  by  (4.4)  is  equal  to  the  risk  R0  defined  by  (4.2).  Therefore,  it  follows 
from  the  discussion  for  the  random  cost  structure  that  the  optimal  design  is  to  choose  m0 
tampering  points  at  x - 0 and  the  remaining  ( n - m0)  tampering  points  at  x - <»,  where  m0  is 
defined  by  (4.3).  In  fact,  as  we  shall  now  show,  there  is  a wide  class  of  functions  with  this  type 
of  solution. 


THEOREM  4:  Suppose  that  the  cost  function  c*(p)  satisfies  the  condition 
<4-7>  c*(p)  ^ pc*{  1)  + (1-  p)c*( 0)  for  0 < p < 1. 


Then  the  total  risk  is  minimized  by  the  solution  obtained  for  the  cost  function  c«  satisfying 
(4.6),  with  c„‘(0)  - p,  and  c0‘(l)  - p2. 

PROOF:  Since  the  cost  function  satisfies  (4.7),  it  follows  that  the  risk  defined  in  (4.4) 
satisfies  the  relation 

<4-«)  *(*, xn)>  E[h(M)\  + £c0*0>,)  ^ Ri 


where  K0‘  is  the  risk  corresponding  to  the  optimal  design  for  the  cost  function  c0*.  However, 
R (xi>  • • • . xn)  - R0  when  x(  - 0 (and  p,  - 1)  for  m0  values  of  /,  and  x,  - «>  (and  p,  - 0)  for 
the  remaining  n - m0  values  of  i.  Hence,  this  solution  is  also  the  optimal  design  for  the  cost 
function  satisfying  (4.7). 


COROLLARY  1:  If  the  cost  function  c*(p)  is  a concave  function  of  p on  (0,  1),  then 
only  the  values  x - 0 and  x - « need  be  used  in  an  optimal  design. 

The  results  presented  thus  far  in  this  section  indicate  that,  for  a wide  class  of  cost  func- 
tions, the  optimal  design  does  not  involve  a partially  accelerated  test  on  any  item.  For  some  of 
the  items,  the  test  is  carried  out  entirely  under  the  standard  stress  conditions;  and  for  the 
remaining  items,  it  is  carried  out  entirely  under  the  higher  stress. 

The  techniques  used  in  proving  the  above  results  can  also  be  helpful  in  problems  in  which 
the  optimal  design  does  involve  partially  accelerated  life  tests.  The  following  results  indicate 
the  kind  of  simplification  that  can  be  obtained  in  characterizing  the  optimal  design. 

THEOREM  5:  If  6 (m)  is  monotone  on  the  integers  0,1 n and  the  cost  function 

c(x)  is  constant  on  some  interval  a < x < A,  then  there  exists  an  optimal  design  that  does  not 
use  any  tampering  point  in  the  interior  of  that  interval. 
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COROLLARY  2:  Suppose  that  him)  is  nonincreasing  on  the  integers  0.1,  ....  n,  and 
there  exist  values  0 - Xq  < x\  < . . . < xk  < x*+,  - 00  and  p0>  vx>  ...  > vk  > i/*+l  ^ 0 
such  that  cix)  - v,  for  xf  < x < x,*+i.  Then  only  the  values  0,  jc  f.  ....  x*  need  be  used  in 
an  optimal  design. 

An  analogous  result  can  be  given  when  him)  is  nondecreasing  and  c(x)  is  a left- 
continuous,  increasing  step  function. 

5.  APPLICATIONS 

In  this  section  we  shall  apply  the  results  of  Section  4 to  the  estimation  problems  con- 
sidered in  Section  3.  Throughout  this  section  we  shall  assume  that  the  loss  functions  have  the 
relative  squared-error  form  (3.3). 


Estimation  of  0 when  9 is  known:  It  follows  from  Theorem  1 that  the  function  h is  of  the  form 
(5.1)  him)  — 6/(A  + m). 


where  b and  A are  positive  constants  that  depend  on  the  prior  distribution  of  /9  and  on  which  of 
the  two  loss  functions  in  (3.3)  is  used.  Here,  the  parameter  0 of  the  exponential  distribution  is 
known,  and  only  the  tampering  parameter  0 is  unknown.  Suppose  that  the  cost  function  c(x) 
is  a nondecreasing  function  of  x.  Then  the  obvious  solution  to  the  optimal  design  problem  is  to 
choose  X,  — 0 for  all  / and  to  tamper  all  observations  immediately.  These  observations  will 
simultaneously  be  the  cheapest  ones  available  and  will  yield  the  maximum  information  about  /3. 
In  general,  for  any  cost  function  c(x),  if  ax  < a2  and  ciax)  < c(a2),  then  the  point  a2  need 
not  be  considered  as  a possible  tampering  point  in  the  optimal  design. 

EXAMPLE  1:  Suppose  that  the  cost  function  c(x)  satisfies  the  following  property: 

(5.2)  c(0)  — v2,  ci°°)  “ V]  < v2,  and 

cix)  > + ip 2 - px)  exp  (-  9qx)  for  0<  x < oo, 

where  0O  *s  the  known  value  of  9.  Here  c(°»)  is  the  cost  of  not  tampering  an  observation  at  all. 
It  follows  from  Theorem  4 that  there  exists  an  optimal  design  with  m0  tampering  points  at 
x - 0 and  the  remaining  n - m0  tampering  point  at  x - oo.  it  can  be  proved  that  the  optimal 
value  of  /n0  is  given  by 

(5.3)  m0  — k for  /*+i  ^ f2  — tkik^  0,1,  ...,  n) , 


where  t0  - oo,  tk  - 6/[(A  + A:  — 1)  (A  + A)1  for  k - 1 n,  and  tn+x  - 0. 

EXAMPLE  2:  Let  the  cost  function  c(x)  satisfy 

v2,  0 < x < a. 


.(5.4) 


cix) 


•M. 


a < x < «>( 


where  v2  > px.  It  follows  from  Corollary  2 that  there  exists  an  optimal  design  with  m,  tamper- 
ing points  at  x - 0 and  n - mx  tampering  points  at  x - a.  To  find  the  value  of  m ,,  define 


(5.5) 


t'm+x  - bie*' - 1) 


_J p 

1 11 

A +m 

A + m + Bm  J 

im  - 0, 1, 


n - 1), 
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where  the  distribution  of  B„  is  binomial,  with  parameters  (/>  - m)  and  exp(  - 90a).  It  can  be 
proved  that  t'„  is  decreasing  in  m and  that  the  optimal  value  of  m t is  given  by 

(5.6)  m,  - k for  f*+1  < v2  - i>\  < f*  (k  - 0.  1,  ....  n), 

where  /©  — °°  and  ln+\  “ 0. 

Now  suppose  that  the  cost  function  c(x)  has  the  form  c(x)  - e,  + (i>2  ~ "i)  exP  ( ~ 8jc) 
for  some  value  of  8 < 0Q.  Then  the  optimal  design  will  contain  some  points  x,  with 
0 < x,  < °o.  For  this  function,  it  can  be  proved  that  the  optimal  design  consists  of  at  least  k 
tampering  points  at  x - 0 if  i>2  - r,  < 60„/[8(A  + k - 1)  (1  + fc)].  However,  the  explicit 
solution  is  not  known. 


Estimation  ofO  only.  Suppose  now  that  both  the  parameters  9 and  j3  are  unknown.  Then  it  fol- 
lows from  Theorem  2 that  the  function  h is  of  the  form 

(5.7)  h(m)  - A/(A  + n — m), 


where  b and  A are  appropriate  positive  constants. 


EXAMPLE  3:  Suppose  that  the  cost  function  c(x)  satisfies  the  following  property: 

c(0)  — Vi,  c(°°)  — > v j,  and 


(5.8) 


c(x)  > P2  — (^2  ~ ‘'l) 


S0 


s 0 + X 


for  0 < x < oo. 


where  /-0  and  s0  are  the  parameters  of  the  prior  gamma  distribution  of  9.  It  follows  from 
Theorem  4 that  there  exists  an  optimal  design  with  m0  tampering  points  at  x - » and  the 
remaining  n - m0  tampering  points  at  x = 0,  where  m0  is  defined  by  (5.3). 


Estimation  of  fi  or  of  both  f3  and  9 when  9 is  unknown:  It  follows  from  Theorem  3 and  the  dis- 
cussion thereafter  that  the  function  h is  of  the  form 


(5.9) 


h(m) 


A,  + m A2  + (n  — m)  ’ 


where  b,  and  A,  are  appropriate  positive  constants.  Furthermore,  it  follows  from  Theorem  4 
that,  it  the  cost  function  satisfies  (5.8),  then  there  exists  an  optimal  design  with  m2  tampering 
points  at  x - 0 and  the  remaining  (n  - m2)  tampering  points  at  x - °°.  It  can  be  proved  that 
the  optimal  value  of  m2  is  given  by 

(5.10)  m2  - for  jt+)  < v2  - v\  < sk  (A:  —0,1 n). 


where  s0  - oo,  jB+,  - 0,  and 

^2 

Sk  ~ (A,  + k - 1)  (A,  + k)  (A2  - k)  (A2  - k + 1) 


n. 


. k - 1 
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We  terminate  this  section  with  an  example  of  a cost  function  in  which  the  optimal  design 
is  concentrated  at  more  than  two  points. 


EXAMPLE  4:  Suppose  again  that  0 is  to  be  estimated  when  9 is  known  to  be  9 q.  There- 
fore, the  function  h is  defined  by  (5.1).  Suppose  that  the  cost  function  c(x)  is  as  follows: 


(5.11) 


c(x) 


2v,  0 < x a,, 
v,  a,  < x < a 2, 


0,  a:,  < x < °°. 


It  follows  from  Corollary  2 that  only  the  values  0,  au  and  a2  need  be  considered  for  an  optimal 
design.  Let  p,'=  exp(-  0O  a)  for  ' “ 1.  2.  For  n — 3,  it  can  be  proved  that  the  optimal 
design  is  to  choose  one  tampering  point  at  each  of  the  three  values  x - 0,  a1(  and  a2  if 


„ . , „ v(A  + 1)  (A  + 2)  (A  + 3)  ^ , . 

" ’ < Mi + 3 -2ft) < fp'  - Pl> ■ 


Otherwise,  the  optimal  design  is  concentrated  on  at  most  two  tampering  points. 
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ABSTRACT 

Independent  samples  are  taken  from  C multivariate  populations  with  con- 
tinuous but  unknown  cumulative  distribution  function  (c.d.O.  The  problem  is 
to  test  the  hypothesis  that  the  C population  c.d.fs  are  identical  to  a specified 
c.d.f.  We  approach  this  problem  by  first  transforming  the  data  so  that  the  hy- 
pothesis being  tested  is  that  the  common  distribution  is  uniform  over  a unit  hy- 
percube. We  then  construct  some  Bayes  tests  and  investigate  their  asymptotic 
properties.  These  tests  are  based  on  the  asymptotic  normality  of  the  number  of 
observations  falling  in  the  "asymptotically  sufficient  groupings." 


1.  INTRODUCTION 

Let  [Xij-j  — 1,2,  ...  n,)  be  n,  independent  observations  from  a population  with  continu- 
ous but  unknown  c.d.f.  = F,  for  / - 1,2,  ...  ,c.  Let  us  denote  the  p components  of  the  obser- 
vation X,j  by  X“,  a = 1,2, p.  We  assume  the  c samples  to  be  independent  and  are 

interested  in  testing  the  hypothesis. 

(1)  H0  : F,-F2- — Ff  — F (say), 

where  Fis  a completely  specified  c.d.f. 

We  approach  this  problem  by  transforming  the  original  variables  X by  using  the  following 
transformation  due  to  Rosenblatt  [4]:  Define 

Z,J  - F(xJ)  - P [ATfj  < xt], 

Z,J  - F(Xj  | Xfi  - P [Xj  < X2  | Jfj  - x,], 

i 


i 


\ 


2,5  - Ftf'  I XP-' X\)  - Plx*  < x„  I XP-'  - x„_, X,h  - X,l. 

It  is  then  easily  seen  that,  when  Hju  is  true,  then  it,  independent  observations 
[XP  ; a — 1,2 p)  are  transformed  into  n,  independent  and  identically  distributed  uniform 
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random  variables  { Z,a,  a — 1,2,  ....  p)  lying  over  the  p — dimensional  unit  cube  Cp  (say). 
Thus,  we  have  reduced  our  problem  of  testing  H,ll)  to  that  of  testing 


H„  : /'  (z1.  z2 


1 if  (z1,  z2,  . 
0,  otherwise. 


zp)  is  in  Cr, 


It  should  be  noted  that,  when  //0U)  is  false,  the  above  transformation  transforms  [X^]  into 
independent  random  variables  { Z,, } laying  over  Cp.  So  for  testing  Ha,  we  consider,  as  neigh- 
boring alternatives  contiguous  alternatives  of  the  form 


(z1,  z2 zf) 


1 + < (z1, 
0,  otherwise. 


z , 


./>) 


if  (z1,  z2 zp)  is  in  CP, 


where  r (z1,  z2,  — , z'7)  satisfies  the  following  regularity  conditions: 
OD  (0  fc  ...  / r'.  (zl,  z2,  ....  z")  dzl  ..  .dzp  - 0 / - 1,2 c; 


dr' 


(»»)—— ^ (z1,  z2 z")  and-—  ' 

9z“  azaaz* 

and  are  such  that 

(1.2)  | rj  (z1,  z2,  ...  , zO  | < B (n), 

3 rl 


(z1,  z2 


9za 


— (z‘,  z2,  ....  z") 


and 


2,, 


82r 


az^z* 


(z1,  z2 z") 


< B ( n ), 


< ^ (n). 


z^  exist 


where 

n = Min,  («,)  and  5 (n)  is  a nonrandom  sequence  satisfying  the  property: 

(1.3)  Lim  n [B  (n)J3  = 0 

n —00 

Here  we  assume  that  max  n , is  of  the  same  order  of  magnitude  as  min 

Let  us  now  discuss  the  reasonableness  of  the  assumptions  we  have  made  on  our  alternate 
hypothesis.  Suppose  we  look  at  an  alternate  hypothesis  of  the  form 


/;  (z1,  z2 z") 


1 1 / (z  , Z , . . . , zO  -ft  1 •)  o.  . 

1 + r * . if  (z  , z zO  is  in  C„ 

0,  otherwise. 


Then  it  is  easily  seen  that  when  8 > y the  asymptotic  power  of  any  sequence  of  tests 
approaches  the  asymptotic  level  of  significance,  and  such  alternatives  are  too  close  to  the  null 
hypothesis  to  be  challenging.  And  when  8 < y it  is  easy  to  construct  tests  for  which  the 
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Notice  that  A^  (at,  a2,  ....  ap)  is  observable.  We  then  have  the  following: 

THEOREM  1:  For  each  sample  i.i  - 1,2 c,  let  [af,  af,  . ...  ap  k - 1,2,  ...  m,j  be 

m,  different  sets  of  p nonnegative  integers,  each  set  containing  at  least  one  positive  value. 
Then,  as  n,  tends  to  infinity,  the  statistic  T„,  where 


(2.5) 


T,  “ I I A 

i-i  *-i 


A <,)J  (af 


«P- 


has  asymptotically  a noncentral  chi-squared  distribution  with  m degrees  of  freedom  and  with 
noncentrality  parameter  AB  where 


(2.7) 


L n'  L An)  (a*.  02 <»P- 

<-i  *-i 


PROOF.  Since  the  c samples  are  assumed  to  be  independent,  it  is  enough  to  prove  that 

£ A„(l)1  (af,  af,  ....  op  has,  asympototically,  a noncentrality  chi-squared  distribution  with  m, 
* 

degrees  of  freedom  and  with  the  noncentrality  parameter  n,  £ A„tl>2  (af,  af,  ....  aft. 

k- 1 

Hence,  it  is  enough  to  prove  that  the  asymptotic  joint  distribution  of 

(af,  af,  ...  , ap  * - 1,  2 m,} 

is  that  of  m,  independent  random  normal  variables  with  expected  values  equal  to 
[yfiii  Ahl)  (af,  af,  , ap  it  - 1,  2,  , m,}  and  variances  equal  to  one.  The  theorem  now 

follows  if  we  use  the  generalizations  to  the  multisample  case  [3]  of  results  on  the  asymptotic 
normality  of  the  number  of  observations  falling  in  the  asymptotically  sufficient  groupings  given 
by  Weiss  16)  for  the  test-of-fit  problem. 

It  is  a consequence  of  the  above  theorem  that  the  statistic  T„  (2.5)  can  be  used  to  test  our 
hypothesis  H„,  which  is  equivalent  to  testing  the  hypothesis  that  the  noncentrality  parameter 
(2.7)  is  zero. 

3.  SOME  BAYES  TESTS  AND  THEIR  ASYMPTOTIC  PROPERTIES 

In  this  section  we  describe  some  Bayes  tests  based  on  T„  (2.5)  and  investigate  their 
asymptotic  properties.  These  tests  are  the  multivariate  and  multisample  extensions  of  those 
given  for  the  univariate  test  of  fit  in  [7], 

From  the  Fourier  series  expansion  (2.1)  for  r^  (z\  z2 zP)  we  have  J"c  ...  J* 

r'|  (z1,  z1 , ....  z0  dz'dz2 ...  , dzp  — ^ ^ ^ A„0)2  (aj,  a2 ap). 

flj— 0 a 2^0  ap-0 

Suppose  we  choose  an  m,  and  assume  that  A„(l>  (af,  af,  ...  , ap  ” 0 for  all  the  vectors 
not  among  those  chosen.  Just  which  sets  (a*,  af,  ...  , ap  are  to  be  chosen  and  the  choice  of 
m,  depend  on  the  alternatives  of  interest  and  the  requirements  on  the  power  function.  These 
are  discussed  for  the  numerical  example  given  in  Section  4.  We  then  have  the  following 
testing-hypothesis  problem: 
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tf0<n  : X I *1"'  <«f.  ap  - 0, 

/-I  *- 1 


and  we  let  the  alternate  hypothesis  be 
(3.2)  ...»  i a 


//j"  : I I A"'  (a  f,  a$ a*)  - c,  (>  0). 

i— 1 k-1 

To  test  //0(l)  (3.1)  against  //ju  (3.2)  suppose  we  assume  a prior  distribution  which  assigns 
a probability  b to  the  point 

Ui  (a‘.  a},  ...  , a,1).  -4;  (a?,  a\,  ...  , a,?).  . . . At,  (a*',  a*' a,"')) 

— (0,  0 0)  for  / - 1,  2,  ...  c. 

and  assigns  probability  (1  - A)  spread  uniformly  over  the  region  £ £ /4B('1  (af,  af,  ....  a/) 

<-i  *-i 

— C|  > 0.  It  is  then  well  known  that  (e.g.,  see  [2]  the  test 
(3.3)  T(u  : Reject  //0<l)  (3.1)  if  T„  > c(a.m), 

where  c(a,m ) is  chosen  to  guarantee  a level  of  significance  equal  to  a,  has  the  following 
asymptotic  properties: 

(i)  It  is  a minimax  test  of  level  of  significance  a;  i.e.,  it  maximizes  the  minimum  asymp- 
totic power  against  alternatives  of  the  form  Ha(n  (3.2)  among  all  tests  with  level  of  significance 


(ii)  It  is  a uniformly  most  powerful  unbiased  test  of  level  of  significance  a. 

(iii)  It  is  a uniformly  most  powerful  invariant  test  of  level  of  significance  a. 

(iv)  Power  considerations:  In  spite  of  the  above  desirable  properties,  it  is  seen  that  for 

c m,  I 

X X (fl*  ai‘  •••  > fixed,  the  asymptotic  power  of  this  test  tends  to  the  asymptotic 

/-i  *-i 

level  of  significance  a as  m,  increases. 

This  means  that  there  is  no  test  for  which  the  asymptotic  power  stays  above  a subject  to 
the  sole  restriction  A„  > c,  > 0 under  H\x)  (3.2).  So  we  have  to  limit  our  class  of  alternatives 
in  some  sense  in  order  to  have  the  asymptotic  power  stay  above  the  asymptotic  level  of 

significance.  One  natural  thing  to  do  is  to  bound  •C  |a^  < u' H dz 1 ...  , dzp  by  a 


constant  different  from  C|  under  H^x).  Such  a discussion  is  carried  out  in  15]  for  the  univariate 
test-of-fit  problem  and  it  extends  to  our  problem  as  well. 

Now  we  describe  a second  Bayes  test  T<2)  (say),  for  which  the  alternate  hypothesis  takes  a 
special  form.  Suppose  that  for  each  sample  /,  / - 1,  2,  ....  c,  and  for  each  n we  have  a set  of 
s,(n)  functions 

rjf  ( z „2 zp\  1),  ri(z*,  z 2 zp\  2) r'  [z1,  z2 zp ; s,  (n)1 

and  let  our  set  of  alternate  hypotheses  consist  of  distributions  with  densities  of  the  form 

j,(») 

i + X 9/ r * (*’«  *2-  ••• » 

/-i 
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for  some  unknown  constants  0(,  »i » - 1.2 c.  Then  we  write  A " (a,.  a2, 

• ••.«,)“  £ (<*i.<»2 a,.;  »,  where 

/-i 

<4„(,)  (a,.  a2,  , af ; j)  - 

Jc  • • ■ J *2  (*‘.  rJ J)2°ia '■  a»  • V ^ cos  (fl/.  IIz*)  rfr1  ...  , 

Thus,  we  are  testing  the  hypothesis  that 

£ (af.  af a*)l  -0/  - 1.2 c. 

against  the  alternative 

s,<»> 

£ lAn  (af,  af of\  j)]  ~ y/n",  X 9]Al,(a\,a2,  ....  af\j). 

7-1 

Now  let  the  r(/i)  vectors  >"($)  (^  - 1,2 f(a)),  where 

af a,1;  *).  ^(uf.  af af,q) 

K (a? a,*';  *). 

be  an  orthonormal  basis  for  the  vector  space  generated  by  the  s,(n)  vectors 
(A„V)  (of.  a j ap\j),  A"  (a,2,  af a/j), 

...  ,^,(,)  (a 7' opj);  J - 1 s,(n)). 

Then  under  our  alternate  hypothesis, 

£ U„(,)  (af.af .af) ] - £ bq  v-i(af,a2,  ....  a£  $) 

<7-1 

for  some  unknown  constants  b",  q - 1,2,  ...,t(n)  and  / - 1,2 c.  Then 

HI,  l(/t) 

£ A"1  (af.af,  ....a*)  - Zb"1. 

*“l  4-1 

which  is  obtained  from  the  orthonormal  property  of  the  Kn’s.  Thus,  we  have  reduced  our  prob- 
lem to  that  of  testing 

ft  at  c l(n ) , 

{3A)  H?'  : X £ b"2  - 0. 

/-I  4-1 

and  we  let  the  alternate  hypothesis  be 

(3’5)  A”  : X 'H  b<t>2  - c2.  c2  > 0. 

/-I  4-1 

To  test  //<j2)  (3.4)  against  //j2)  (3.5),  let  us  assume  a prior  distribution  which  assigns  a proba- 
bility b to  the  point  X X bq')2  " 0 over  the  space  of  the  bf^s  and  distributes  the  remaining 

I 4 

probability  uniformly  over  the  region  X £ bfl)2  " cv  Then  the  usual  simple  calculations 

i q 

show  that  a Bayes  Decision  rule  relative  to  the  above  prior  distribution  is  given  by 


</)J 


(3.6) 

T(2) : Reject  //0(2) 

where 

(3.7) 

T(2) 

M n 

t™-  in.  $: 


/-I  4“1 


I 
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\(,)  - 1/  L (fl* aP  y!>  <fll «*.*>• 


*-l 


and  c(a;cf(/i)l  is  chosen  to  guarantee  a level  of  significance  equal  to  a.  It  is  easily  seen  that 
y/fT,  bj'*  is  asymptotically  normally  distributed  with  mean  equal  to  yfn,  b}'\  covariances  equal 
to  zero,  and  variance  equal  to  one.  Since  the  c samples  are  assumed  to  be  independent,  we  see 
that  when  //<j2)  (3.4)  is  true  T„t7)  has  a central  chi-squared  distribution  with  ct(n)  degrees  of 
freedom.  Thus,  for  the  test  f<2>  (3.6),  c[a;cf(/r)]  is  the  appropriate  value  from  the  chi- 
squared  table  with  ct(n)  degrees  of  freedom.  This  test  has  the  following  asymptotic  properties. 


(i)  It  is  a minimax  test  of  level  significance  a against  the  class  of  alternatives  of  the  form 

(3.5). 


(ii)  It  is  a uniformly  most  powerful  unbiased  test  of  level  of  significance  a. 

(iii)  It  is  a uniformly  most  powerful  invariant  test  of  level  of  significance  a. 


(iv)  Power  considerations:  Suppose  that  under  the  alternate  hypothesis,  the  true  density  is 
given  by 


1 + r\0)  ( z'.z 2 zO. 

Define  A*}'2  (a ,,  a2 a.)  to  be  the  same  function  of  r*}()  (z\z2,  . . . .zO  as  A l* 

(a,,a2.  ....  ap)  is  of  r'(zl.z2  . . . ,z*7.  We  then  write  the  vector 

(a/.aj, . . . , a}),  Am*(,)  (fl2.a2 a}),  ....  A*ji}  ( a a”')] 

as  equal  to 


(3.8) 


((») 


I V‘  ( q ) + bnV*i'\ 


<7-1 


where  K\(f)  is  orthogonal  to  (KjO),  Vi,(2),  ....  V'„  (r (/»))].  Then  T„(2)  has  a noncentral 
chi-squared  distribution  with  ct(n)  degrees  of  freedom  and  noncentrality  parameter  A„(2), 
where 


(3.9) 


tin) 


A<2>  - I h,  I b\U)1. 


/-I 


From  the  definition  of  rn(2)  (3.7)  and  A^2)  (3.9)  we  have,  as  tin)  increases, 

(r<2)  - ctin)  - A<2'] 


yjlctin)  + 4 A 


(2) 


is  asymptotically  distributed  as  a normal  random  variable  with  zero  mean  and  unit  vari- 
ance, and  hence  we  conclude  that  [A^2)/  Vc/(n)]  must  be  bounded  away  from  zero  in 
order  to  have  the  asymptotic  power  stay  above  the  asymptotic  level  of  significance,  against 
alternatives  of  the  form  {1  + (z',z2 z1)). 


We  now  construct  a third  Bayes  test,  which  we  call  an  "all-purpose”  test,  in  the  sense  that 
it  does  not  depend  on  any  special  set  of  alternatives.  We  assume  a prior  distribution  which 
assigns  a probability  qiq  > 0)  to  the  point 

E[A%n  (af.aj,  ....  a*))  - 0,  A:  - 1,2,  ...  m,,  i - 1,2 c, 

— — ® — to  each  of  the  m(m-l)  points  with 


and  assigns  probability 


m(m-l) 

Eft"  (af'.aj1 a,*1)]  - - A<3>. 

EU"  ia\\a\' a*2)]  - A<3). 


1 
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EW*  C a[\a2\ a*3)]  — 0, 

c 

for  k 3 & kitk2,  that  we  get  as  we  vary  Ac,  and  k2  from  1 to  m,  with  Ar,  k2,  where  m - Z m,. 

i- 1 

The  usual  simple  calculations  then  show  that  a Bayes  Decision  rule  relative  to  the  above  prior 
distribution  is  given  by 

T(3) : Reject  (3.1)  if  T„(i)  is  "too  large,"  where 

M I1\  c mi 

T'3)  " ,5  £2  eXP  ^ W'  Of* Jn')  ~ A"j\\ /,*))). 

*1*2"  1 

To  investigate  the  properties  of  T01  (3.10)  we  expand  T„°\  using  the  expansion  e*  - 1 + 
x + x2/2  + ...  , and  use  the  fact  that 

I lA}n  (jI' /,')  - A"  (j\\  .... 

*1  * *2 

is  zero  if  s is  an  odd  integer.  Then,  if  A,i3>  tends  to  zero  as  n increases,  we  find  that  the  asymp- 
totic properties  of  the  test  T01  (3.10)  are  the  same  as  those  of  T"0’  (3.3). 

Now  let  the  true  density  under  the  alternate  hypothesis  be 

(1  +Tn(i)  (z1.  ....  zt). 

Define 

(a],a2 ap)  to  be  the  same  function  of  7 i (z'.z2, z")  as  An(i)_(aua2 a„)  is 

of  r‘n  ( z',z2,  ....  zO.  Then  T^\  given  by  (3.11)  with  A„(lh  s replaced  by  Bn(lhs  has  asymptoti- 
cally, a noncentral  chi-squared  distribution  with  m degrees  of  freedom  and  noncentrality  parame- 
ter A<3)  (say),  where 

A<3)-  Z n,  l'  « .... 


and  hence  the  distribution  of 


unit  variance. 


( Tn(3)  -m-  A<3)) 


is  asymptotically  normal  with  zero  mean  and 


For  the  same  level  of  significance,  the  asymptotic  power  of  the  all  purpose  test  Ta)  (3.10) 
will  be  greater  than  the  asymptotic  power  of  T(2)  (3.6)  if 

t mi  , c tin)  , 

I n,  Z Bn(i)  (a [.a k2.  ....  a*)  Z n,  Z 6%(,)2 


/-I  k- 1 

c 

Z m. 

/-i 

We  see  that  if  bn  in  (3.8)  is  nonzero,  then 


C 

But,  on  the  other  hand,  m - ( Z^  m*)  is  likely  to  be  higher  than  ct(n).  Thus,  even  though  the 

test  r3)  based  on  T„(i)  is  an  all-purpose  test,  it  is  less  powerful  than  the  test  T*21  based  on  Tjj2) 
against  alternatives  used  in  its  construction. 
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4.  A NUMERICAL  EXAMPLE 

We  will  now  give  a numerical  example  to  illustrate  a test  procedure  based  on  T„  (2.5)  for 

the  case  when  c - 3 and  p - 2.  Following  the  notations  used  so  far,  {X,j,  J — 1,2 n,)  are 

n i independent  observations  from  a population  with  continuous  cumulative  distribution  func- 
tion F,  for  / — 1,2,  and  3.  Let  the  null  hypothesis  be 

H0  : F , - Ft  - Fj  (-F  say), 

where  F is  the  cumulative  distribution  function  of  a bivariate  normal  random  variable  with  zero 
mean,  unit  variance,  and  correlation  coefficient  equal  to  0.4. 

Since  the  multivariate  normal  distributions  differ  from  one  another  only  in  their  location 
parameters  or  covariance  matrices,  we  will  consider  an  alternate  hypothesis  where  F's  have  the 
same  location  parameters  but  have  different  covariance  matrices.  So  let  our  alternate 
hypothesis  be 

H i : F,  is  the  cumulative  distribution  function  of  a bivariate  normal  random  variable  with 
zero  mean,  unit  variance,  and  correlation  coefficient  equal  to  p,  for  / — 1,2,  and  3,  where 
Pi  — 0.6,  p2  — 0.4,  and  p3  — 0.2. 


For  convenience  let  us  take  n,  - 100  for  / — 1,2,  and  3.  By  using  the  method  given  by 
Box  and  Muller  [1],  we  then  generate  a Monte  Carlo  sample  of  100  independent  pairs 
{( Xij.Xjj ),  J — 1,2,  ....  100}  from  each  of  the  three  bivariate  normal  distributions  considered 
under  Hx.  Application  of  Rosenblatt’s  transformation  based  on  Fto  (A^)  then  gives 

(4.1)  Z,J  - 1 — 0UTJ), 

Xjj  - 0 • 4AT,j 

Vl  - 0.16 

for  /'  — 1,2,3  and  j — 1,2,  , 100,  where 


(4.2) 


Zt  - 1 - <6 


00)  - jf  (2n)-l/2exp  (-  y2/ 2)  dy. 


We  then  divide  the  unit  square  C2  into  nine  (say)  equal  parts.  The  center 

Ln(b ) - [L„>  ( b ),  L?(b)) 

of  each  subsquare  S„(b)  and  the  number  Nh(b)  of  observations  Z,7  from  the  i'*  sample  falling 
in  the  subsquare  Sn(b)  are  given  in  Table  1.  Our  next  step  is  to  compute  A„(,)  ( a,,a2 ) for 
i ” 1,2,3,  and  we  proceed  as  follows.  First  we  have  to  decide  on  which  sets  (aua2)  are  to  be 
chosen.  Since  we  are  interested  in  alternatives  which  differ  from  the  null  hypothesis  only  in 
their  values  for  the  correlation  coefficients,  and  since  the  above  transformations  (4.1)  and  (4.2) 
use  the  correlation  coefficient  only  for  transforming  the  second  co-ordinate,  it  is  clear  that  we 
should  emphasize  a2  more  than  ax.  So  let  us  take  (alta2)  for  each  sample  as  follows: 

Sample  1 : (ax,a2)  - {(0,1),  (1,0),  (1,1),  (0,2)} 

Sample  2 : (a„fl2)  - {(0,1)  , (1,0),  (1,1)} 

Sample  3 : (ax,a2)  - {(0,1),  (1,0),  (1,1),  (0,2)}. 

We  then  compute  A*,}  (a,,a2)  by  using  (2.4),  and  the  results  are  given  in  Table  2.  Table  3 
gives  the  value  of  our  test  statistic  T„. 


1 


. . . Aji 


J 
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But  from  Theorem  1 we  know  that  T„  (2.5)  has  a central  chi-squared  distribution  under  H0 
with  1 1 degrees  of  freedom.  Referring  to  the  chi-squared  tables,  we  get 

X2"  °°05  - 26.75 

and 

X2>l  001  - 24.72. 

Hence,  using  T„  as  our  statistic  to  test  H0  against  //,,  we  get  a level  of  significance  between 
0.005  and  0.01. 
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ABSTRACT 

We  consider  ihe  multiple-attribute  decision  problem  with  finite  action  set 
and  additive  utility  function.  We  suppose  that  the  decision  maker  cannot  speci- 
fy nonnegative  weights  for  the  various  attributes  which  would  resolve  the  prob- 
lem, but  that  he/she  supplies  ordinal  information  about  these  weights  which 
can  be  translated  into  a set  of  linear  constraints  restricting  their  values.  A 
bounded  polytope  W of  feasible  weight  vectors  is  thus  determined.  Supposing 
that  each  element  of  W has  the  same  chance  of  being  the  'appropriate  one,"  we 
compute  the  expected  utility  value  of  each  action.  The  computation  method 
uses  a combination  of  numerical  integration  and  Monte  Carlo  simulation  and  is 
equivalent  to  finding  the  center  of  mass  of  the  bounded  polytope  W.  Compari- 
sons are  made  with  another  criterion  already  presented,  the  comparative  hyper- 
volume criterion,  and  two  small  examples  are  presented. 

1.  INTRODUCTION 

The  work  reported  here  builds  upon  that  in  our  previous  paper  [3),  in  which  both  prob- 
lems of  multiple-attribute  decision  making  with  partial  information  and  the  comparative  hyper- 
volume  criterion  for  resolving  such  problems  were  defined  and  discussed.  Our  objectives  here 
are  to  present  a second  decision  criterion,  the  expected-value  criterion,  which  may  be  used  in 
such  problems,  and  to  contrast  it  with  the  aforementioned  comparative  hypervolume  criterion. 

For  completeness,  and  because  not  much  space  is  required,  we  shall  not  rely  on  a 
knowledge  of  the  material  contained  in  [3];  all  that  is  needed  will  be  developed  here.  All 
necessary  definitions  and  background  will  be  presented  in  this  introductory  section.  The 
expected-value  criterion  (EVC)  and  its  relation  to  the  comparative  hypervolume  criterion 
(CHC)  will  be  presented  in  the  following  section,  and  in  Section  3 we  will  discuss  the  numeri- 
cal procedure  needed  to  compute  the  values  required  by  the  EVC.  In  the  final  section  two 
numerical  examples  will  be  presented.  We  now  move  to  a development  of  the  notation  and  a 
framing  of  the  problem. 


250  J R CHARNETSKI  AND  R M SOLAND 

We  are  concerned  with  finite-action  decision  problems  in  which  the  decision  maker(s) 
(DM)  must  choose  one  action  from  a finite  set  A of  feasible  actions.  Each  action 

a,  € A.  i — 1 m,  has  been  evaluated  with  respect  to  each  criterion  (or  attribute)  c , in  a 

finite  set  C = (c, c„ ) of  criteria.  Define  s;y  to  be  the  raw  score  of  action  a,  with  respect 

to  attribute  c,;  for  each  c,  the  scores  s,j  may  be  on  either  an  ordinal  or  an  interval  scale. 

Our  supposition  is  that  the  DM  wishes  to  choose  an  action  on  the  basis  of  maximum  util- 
ity (or  value),  where  the  utility  of  action  a,  is  u*(a,)  - u(s,|,  ....  sw).  We  further  assume 
that  an  additive  form  for  the  utility  function  u is  appropriate  (see  Keeney  and  Raiffa  [5]  for 
necessary  and  sufficient  conditions  for  such  additivity)  so  that 

(1)  u*(a/)  - u(s(1>  ....  s,„)  = £ w,(s(/). 

/-i 

As  indicated  by  Keeney  and  Raiffa  (5,  p.  116],  the  functions  u*and  ut(J  = 1,  ....  n ) may  be 
scaled  to  the  interval  [0,  1]  so  that  Uj(.s,j)  may  be  written  as  w,v,/,  where  vu  is  the  relative  value 
of  the  raw  score  s„  based  on  the  set  of  all  scores  skJ  with  respect  to  attribute  c,,  and  each  w,  is  a 
positive  weight.  If,  as  is  natural,  the  v,,  are  also  scaled  from  zero  to  one  for  each  attribute  c„ 
then  the  weights  w,  must  sum  to  unity,  and  the  utility  of  action  a,  now  has  the  form 

(21  u *(a,)  - £ wj  v,j. 

j- 1 

A significant  advantage  of  this  form  is  the  relative  ease  with  which  the  DM  can  determine 
the  vu  values  (see  Keeney  and  Raiffa  (5,  Section  3.7]  for  further  discussion  and  an  illustrative 
example).  Let  us  define  V as  the  m by  n matrix  of  vu  values;  for  each  column  j the  values  v„ 
lie  between  0 and  1 inclusive,  with  at  least  one  of  them  taking  each  of  these  extreme  values. 
With  V,  the  / th  row  of  V and  w a column  vector  of  the  weights  wy,  expression  (2)  becomes 

(3)  u*(o,)  - Vty/. 

If  the  DM  provides  a weight  vector  w = w*,  then  (3)  provides  the  basis  for  selection  of 
an  action.  In  many  cases,  however,  the  DM  may  not  be  willing  (or  able)  to  provide  a particular 
w*.  In  the  case  of  an  individual  decision  maker  this  may  be  simply  due  to  the  fact  that  he/she 
cannot  articulate  his/her  preferences  with  the  needed  precision.  In  the  case  of  a group  of  deci- 
sion makers,  there  may  be  considerable  disagreement  about  the  appropriate  weight  vector  w* 
(see  Sengupta,  et  al.  [6]  for  further  treatment  of  this  case). 

Our  hypothesis  in  the  following,  therefore,  is  that  the  DM  does  not  provide  a particular 
w*,  but  rather  that  he/she  provides  information  which  allows  the  construction  of  a set  W of 
vectors  to  be  considered.  More  formally,  we  define  W as  the  set  of  weight  vectors  that  the  DM 
deems  feasible,  i.e.,  may  be  appropriate  ones  in  light  of  his/her  subjective  feelings  (or  in  light 
of  their  range  of  agreement  if  there  are  several  decision  makers).  We  shall  confine  ourselves  to 
the  case  in  which  W is  characterized  by  a number  of  linear  equality  and/or  inequality  con- 
straints on  the  components  w/  of  w;  see  [3]  for  a discssion  of  how  appropriate  linear  constraints 
may  be  construcuted.  These  constraints  must  include  the  normalization  constraint  £w,  - 1 

and  the  nonnegativity  constraints  w,  > 0,  J — 1 n (each  w,  must  actually  be  positive,  but 

nothing  is  lost,  in  a numerical  sense,  by  writing  w,  > 0).  In  a general  sense,  therefore,  we  may 
write 

(4)  W - (w  € E"|  Aw  < b), 

where  A is  an  s by  n matrix  of  constraint  coefficients  and  b is  the  s by  1 vector  of  right-hand- 
side  values.  W is  thus  a bounded  polytope  in  E”. 
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We  mention  two  special  cases:  (1)  that  in  which  W - {w*|,  i.e.,  it  is  known  that  w 
which  we  call  the  case  of  complete  information ; and  (2)  that  in  which 


(5) 


W - W = |w  € Elw  > 0.  £ 


W; 


1). 


which  we  call  the  case  of  no  information.  We  refer  to  the  general  case,  which  falls  between 
these  two  extremes,  as  the  case  of  partial  informa'  >n , and  thus  characterize  the  decision  prob- 
lem with  which  we  deal  as  one  of  multiple-attribute  decision  making  with  partial  information. 


The  problem  we  address  here  is  formally  equivalent  to  that  considered  by  Fishburn,  Mur- 
phy, and  Isaacs  (4]  in  the  context  of  decision  making  under  uncertainty  with  incomplete 
knowledge  of  the  probabilities.  They  mention  six  possible  approaches,  several  of  which  have 
elements  in  common  with  the  development  which  follows.  Also  see  Charnetski  (1). 


2.  THE  EXPECTED-VALUE  CRITERION 


Given  W,  it  is  not  immediately  clear  as  to  how  it  should  be  used  to  aid  the  DM  in  select- 
ing an  action  a,  for  implementation.  In  [3]  we  suggested  the  use  of  the  comparative  hypervol- 
ume criterion  (CHC),  which  effectively  determines  for  each  action  a,  € A the  relative  measure 
r,  of  that  subset  H,  of  W in  which  a,  has  the  highest  utility  value  of  all  actions.  We  then  select 
as  "best"  the  action  with  the  highest  comparative  hypervolume  r,.  In  effect,  this  treats  all  ele- 
ments w 6 W as  equally  probable,  and  then  choses  an  action  which  is  "most  likely"  to  have  the 
highest  utility  value.  Precise  definitions  of  r,  and  H,  will  be  given  below. 


A deficiency  of  the  CHC  is  the  possibility  that  no  action  a,  may  have  a very  high  value  of 
rf  (e.g.,  rx  — 0.26,  r2  = 0.24,  r}  = 0.20,  r4  = 0.18,  r5  — 0.12),  so  that  the  basis  for  choice 
becomes  less  clear.  Moreover,  the  relative  measures  r,  are  clearly  affected  by  the  number  of 
action  choices.  Another  argument  against  the  CHC  is  that  it  does  not  account  for  the  fact  that 
an  action  may  not  be  very  likely  to  yield  the  highest  utility  value,  but  may  nevertheless  yield  a 
high  utility  value  for  many  w € W,  or  "on  the  average."  If  this  sounds  somewhat  like  an  argu- 
ment in  favor  of  expected  value  as  opposed  to  maximum  likelihood,  in  the  context  of  a simple 
decision  problem  with  a finite  number  of  possible  states  of  nature,  it  is,  because  the  situation  is 
directly  analogous.  Again  treating  all  w € W as  equally  probable,  one  could  compute  the 
expected  utility  value  for  each  action,  and  then  choose  the  action  with  the  highest  such 
expected  utility  value.  This  is  the  expected-value  criterion  (EVC),  which  we  shall  now  proceed 
to  formalize. 


Let  K = f by  the  hypervolume  of  W.  Then  K '(dvr)  is  the  probability  measure 
over  W with  which  we  must  deal.  We  may  obtain  the  expected  utility  value  u*(a,)  of  action  a, 


as 


(6)  u*(a,)  - K 1 J*w  u*(o,)  rfw 

- *"/*(>»  rfw 

“ *-1  /w  |L 

- *_1  L vu  Jw  V" 


- 2>,w, 


V,m, 
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where  w - (wj,  ....  w„)  T is  the  mean  weight  vector  (or  center  of  mass  of  W).  The  EVC  says 
to  select  the  action  a,  with  the  highest  expected  utility  value  u *(«,).  In  the  next  section  we 
shall  deal  with  the  actual  computation  of  the  u*(a,)  values,  but  first  we  will  explore  some  rel- 
tionships  between  the  EVC  and  the  CHC. 

For  the  CHC  we  use  the  definitions 

(7)  H,  = (w  € W|  V,m  ^ Kkw,  k - I m). 

(8)  r,  = K~]  J*H  dm. 

According  to  the  EVC,  we  select  action  a,  if  and  only  if  V^m  ^ Vkm , k - 1 m.  From  (7) 

we  see  that  this  is  equivalent  to  choosing  a,  if  and  only  if  w 6 H,,  i.e.,  the  EVC  says  to  choose 
an  action  a,  such  that  w € H,. 

The  fact  that  u*(a,)  ^ u*(aA)  for  all  k if  and  only  if  w € H,  leads  one  to  conjecture  that 
perhaps  the  EVC  and  the  CHC  are  equivalent  in  that  u*(a,)  > u *(ak)  for  all  k if  and  only  if 
r,  > rk  for  all  k.  Example  1 of  the  appendix  shows  this  conjecture  to  be  false.  A weaker,  but 
similar,  conjecture  involves  the  comparison  of  only  2 actions.  Defining 

(9)  H,*  = {w  € W|  V,m  > Kaw)  and  r,k  = K~[  f„  dm, 

the  conjecture  is  that  u*(a,)  > u*(aA)  if  and  only  if  rik  > rki.  This  is  false  in  general  (see 
Example  2 of  the  appendix),  but  it  is  true  when  the  dimension  d of  W is  1,  i.e.,  whenever  W is 
a line  segment  in  E If  we  neglect  the  case  of  perfect  information,  this  is  always  the  case  if  n 
= 2. 

3.  COMPUTATION  OF  THE  u*(a,) 

The  value  of  the  u*(a,),  as  defined  by  (6),  cannot  be  calculated  analytically  because  of 
the  integration  over  W required.  Although  W has  an  explicit  characterization  as  a polytope, 
only  in  very  exceptional  situations  will  it  be  possible  to  perform  the  required  integration 
exactly.  (Note  that  the  cases  of  complete  information  (w  = w*)  and  no  information 

(w  = (1  In 1 In))  are  two  such  situations.  For  the  general  case  we  turn  to  Monte  Carlo 

simulation  as  a means  of  obtaining  accurate  approximations  of  the  u*(o,). 

From  line  2 or  3 of  (6),  as  well  as  from  its  interpretation,  it  is  seen  that  u*(a,)  is  the 
expected  value  of  a linear  function  defined  over  the  bounded  polyhedral  subset  W of  E".  In  [2] 
we  gave  a detailed  Monte  Carlo  procedure  for  estimating  such  expected  values.  This  approach 
would  require  one  Monte  Carlo  simulation  for  each  a , € A,  but  this  is  less  efficient  than 
estimating  the  mean  weight  vector  w and  then  using  the  result  u*(a,)  - V, w.  The  procedure 
of  [2]  is  easily  adapted  to  give  w directly  and  with  only  one  Monte  Carlo  run;  we  give  this  adap- 
tation here  because  it  then  provides  a simple  procedure  for  determining  the  center  of  mass  w of 
any  bounded  polyhedral  set  W defined  by  a finite  set  of  linear  inequalitites. 

Recall  that  W = {w  € E"|Aw  < b},  where  A is  s by  n.  Let  A,  be  the  / th  row  of  A.  Let  y 
be  a nondegenerate  vertex  of  W (obtained  after  some  simplex  pivots  or  by  perturbation  of  a 

degenerate  vertex  if  necessary),  and  let  (v',| p = 1 d\  be  the  set  of  unit  vectors  defining 

the  directions  of  the  edges  of  W incident  to  y.  Because  y is  nondegenerate,  d is  the  dimension 
of  W(</  ^ n — 1).  Thus,  the  set  <J>  of  all  unit  vectors  <b  originating  at  y and  directed  into  W, 
may  be  written  as 

(10)  * " (0I0  = L epyp/\\  £ all  ep  > o). 


(10) 
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and  for  arbitrary  <t>  € <t>  we  define  the  scalar 

(ID  A (<f>)  - min/ {A/ (0) | A/ (0)  - ( b A,y)lA,<\>,  for  A,<f>  > 0). 

A (0)  is  just  the  "width”  of  W in  the  direction  <f>.  With  a sequence  of  uniform  (pseudo) random 
numbers  we  can  generate  random  unit  vectors  <t>  € d>  by  use  of  (10).  Numbering  these 
<£',  <(>2,  . . . , we  obtain  a sample  of  size  M,  and  may  estimate  w by 

(12)  w - y + d £ {A(<W+1  /(</  + 1)  £ {A(**)}rf. 

*-i  *-i 


Care  must  be  taken  in  the  generation  of  the  random  unit  vectors  <£  € < 1>  through  use  of 
(10)  in  order  that  this  sampling  of  elements  of  O be  unbiased.  The  most  natural  procedure  is 
that  in  which,  if  we  take  successive  outputs  of  a (pseudo) random-number  generator,  the  suc- 
cessive ep  are  independent  and  uniformly  distributed  on  the  interval  (0,  1).  If  we  take 

(13)  <t>  = £ epyp/\\  £ Vr/’11- 

p- 1 p- 1 

the  sampling  technique  actually  yields  a biased  choice  for  0.  We  may  avoid  this  bias,  however, 

if  only  sequences  (e, ed)  with  a special  property  are  used,  and  the  others  discarded.  If  all 

pairs  of  unit  vectors  (v  p,  v *0 , 1 < p < q < d,  form  acute  angles  (verified  by  the  inner  product 
<\p,  \q>  ^ 0),  then  it  is  necessary  to  discard  all  sequences  (e,,  ....  ed)  for  which 
II  £ ^v^l  > 1.  This  follows  from  the  argument  that  all  points  of  the  form  y + £ epyp  are 

p p 

equally  likely,  so  that  if  only  those  within  the  unit  hypersphere  centered  at  y (for  which 
II  ^CpV'll  < 1)  are  retained,  then  all  unit  vectors  defined  by  (13)  are  equally  likely.  On  the 

p 

other  hand,  if  any  pair  of  unit  vectors  (yp,  v4)  forms  an  obtuse  angle,  then  it  is  necessary  to 
further  restrict  the  generated  sequences  (elf  ....  ed)  to  those  for  which  II  £epv,’ll  ^ U where  t 

p 

= (1  — cos2/3)1/2  and  j3  is  the  largest  angle  between  pairs  of  unit  vectors  (yp,  v'O.  This  is 
because  in  this  case  of  an  obtuse  angle  not  all  points  within  the  unit  hypersphere  centered  at  y 
can  be  obtained  as  y + Y*epyP  f°r  some  sequence  (^ ed).  But  y + ^epyp  can  generate 

p p 

all  points  within  the  hypersphere  of  radius  t centered  at  y. 

Clearly,  the  necessity  of  discarding  some  sequences  (e,,  , ed)  decreases  the  overall 

computational  efficiency  of  the  procedure,  perhaps  significantly  in  those  cases  for  which 
t « 1.  In  the  event  that  {vp)  yields  some  obtuse  angles  at  y and  that  t « 1,  it  might  be 
computationally  more  efficient  to  reject  y as  the  origin  and  search  for  another  vertex.  One 
might  limit  the  search  to  those  vertices  adjacent  to  y,  stopping  if  the  new  sets  {v/’}  form  acute 
angles  only,  or,  failing  that,  choosing  the  vertex  which  allows  the  maximum  value  of  t < 1. 
Hence,  additional  research  on  generating  the  </>  € <1>  is  clearly  desirable.  For  the  two  example 
problems  presented  in  the  next  section  the  generation  method  indicated  above  was  used  along 
with  the  detailed  methods  given  in  [2]  and  (3J. 

4.  EXAMPLE  PROBLEMS  AND  COMPUTATIONAL  RESULTS 

We  consider  the  following  decision  problem  (from  Sengupta,  el  al  (6]).  Table  1 describes 
the  action  choices  and  their  evaluations  s0  with  respect  to  three  criteria.  (The  s„  were  left  un- 
sealed in  this  example  to  facilitate  comparisons  with  the  results  given  in  [6].) 


I 
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Criteria 


Action 


0| 

«2 

«3 


Additionally,  we  assume  the  set  W to  be  specified  by: 

h>|  > 0.4,  0.1  < *v2  < 0.7, 

3 

£ Wj-  1,  and  wj  ^ 0 0 for  every  j. 

j- 1 

A FORTRAN  code  executed  on  an  IBM  370/148  machine  at  the  Louisiana  Tech  Computational 
Center  produced  the  results  shown  in  Table  2. 

Table  2 


Action 

Expected 

Value 

<Ji 

6.656 

5.400 

03 

4.687 

These  expected  values  and  hypervolumes  are  based  on  a sample  of  1500  random  vectors.  The 
CPU  time  was  16.66  s,  or  approximately  1.11  s per  100  vectors  generated. 

For  the  second  example  problem,  we  have  the  decision  matrix  V shown  in  Table  3. 


Criteria 


Action 


«i 
2 


We  assume  the 

following  constraints  specify  the  set  W: 

**'1 

~ Wl 

- 

"a 

< 0. 

" H-2  + Wj 

+ WA 

+ 

"5 

*?  0, 

-w, 

+ 

»2 

< 0, 

-W2 

+ 

»3 

< 0, 

-Wj 

+ 

*4 

< 0, 

-H-4 

+ 

"s 

< 0, 

WS 

> 0.05, 
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and 

5 

£ Wj  - 1,  Wj  > 0,  for  every  j. 
j- 1 

Again  using  a sample  of  1500  random  vectors,  the  results  in  Table  4 were  obtained  (the  CPU 
time  was  56.9  seconds). 


Table  4 


Action 

Expected 

Value 

Hypervolume 

ai 

mm 1 

wm 

0.137 

0.259 

m 

ifSl 

0.0 

m 

0.651 

0.604 

mm 

0.225 

0.0 

5.  APPENDIX 


Here  we  present  the  two  counterexamples  mentioned  in  Secton  2.  Consider  first  the  3 by 
2 adjusted  payoff  matrix  V: 

10  0 

0 10 

5 + lOe  5 + lOe 

where  e is  a small  positive  number.  Let  W = W,  the  case  of  no  information.  Then,  clearly, 
w — (0.5,  0.5) r,  so  that  u*(fli)  = u*(a2)  = 5,  whereas  u*(a3)  = 5 + lOe.  The  H,  are: 


H,  = |(w1,  w2)r|0.5  + e < w,  < 1,  wj  + w2  - l|, 
H2  — l(wlf  w2)r|0  < < 0.5  — e,  w,  + w2  - 1 


and 


H, 


( Wi , w2)  t | 0.5  — e < w,  <0.5  + 6,  *v(  + w2  — 1 


Hence,  r,  = r2  - 0.5  - e,  whereas  r3  = 2e.  Thus  u*(a3)  < u*(a*)  for  all  k,  but  r3  « rk  for 
k - 1,  2. 


For  the  second  counterexample,  take  V as  follows: 

V 


7 0 10 

10  3 3 

0 10  0 


Again  take  W - W.  Then  w — (1/3,  1/3,  1/3) r,  so  that  u*(a,)  =*  17/3,  16/3,  and  10/3  for  i 
- 1,  2,  3,  respectively.  The  definition  (9)  of  H12  gives: 


H„- 


(w,,  w2,  w3)T\  w,  + *v2  < 0.7;  all  w(  ^ Of, 
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and  then  straightforward  computaton  yields  rn  “ 0.49.  Hence  r2,  - 0.51  (since  rlk  + rkl  - 1) 
and  r2)  > ri2  although  u*(a2)  < uVa,). 

If  W is  a line  segment  in  E",  with  w therefore  at  the  midpoint,  then  it  is  clear  that 
« *(<»/)  > 5*<a*)  >f  and  only  if  r,k  > rk„  since  w € H,*  if  and  only  if  rlk  ^ rki. 
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ABSTRACT 

This  paper  models  a k-unit  service  system  (e.g.,  a repair,  maintenance,  or 
rental  facility)  with  Poisson  arrivals,  exponential  service  times,  and  no  queue. 
If  we  denote  the  number  of  units  that  are  busy  as  the  state  of  the  system,  the 
state-dependent  pricing  model  formalizes  the  intuitive  notion  that  when  most 
units  are  idle,  the  price  (i.e.,  the  service  charge  per  unit  time)  should  be  low, 
and  when  most  units  are  busy,  the  price  should  be  higher  than  the  average.  A 
computationally  efficient  algorithm  based  on  a nonlinear  programming  formula- 
tion of  the  problem  is  provided  for  determination  of  the  optimal  state- 
dependent  prices.  The  procedure  ultimately  reduces  to  the  search  on  a single 
variable  in  an  interval  to  determine  the  unique  intersection  point  of  a concave 
increasing  function  and  a linear  decreasing  function.  The  algorithm  takes,  on 
the  average,  only  about  1/2  second  per  problem  on  the  IBM  360/65  (FOR- 
TRAN G Compiler).  A discrete  optimal-control  approach  to  the  problem  is 
shown  to  result  in  essentially  the  same  procedure  as  the  nonlinear- 
programming  formulation.  Several  properties  of  the  optimal  state-dependent 
prices  are  given.  Comparisons  of  the  optimal  values  of  the  objective  function 
for  the  state-dependent  and  state-independent  pricing  policies  show  that  the 
former  is,  on  the  average,  only  about  0.7%  better  than  the  latter,  which  may 
explain  partly  why  state-dependent  pricing  is  not  prevalent  in  many  service  sys- 
tems. Potential  generalizations  of  the  model  are  discussed. 


INTRODUCTION 

This  paper  deals  with  the  short-run  pricing  decisions  for  multiunit  service  systems  such  as 
repair  or  maintenance  facilities,  equipment  rentals,  car  rentals,  motel  rentals,  and  the  like.  Due 
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to  the  stochastic  nature  of  the  requests  for  such  services  and  the  probabilistic  nature  of  service 
times,  the  number  of  units  that  are  busy,  referred  to  as  the  state  of  the  system,  also  exhibits 
stochastic  variations.  When  most  of  the  units  are  idle,  it  makes  intuitive  sense  that  the  firm 
should  lower  its  price  (i.e.,  service  charge  per  unit  time)  so  as  to  attract  more  customers  to  the 
system.  If,  however,  most  of  the  units  are  already  busy,  the  firm  may  want  to  charge  a higher 
than  normal  price,  since  in  such  a case  the  firm  can  afford  to  wait  for  better-paying  customers. 
Such  a pricing  policy,  where  the  price  depends  on  the  state  of  the  system,  will  be  referred  to  as 
a state-dependent  pricing  policy.  In  contrast,  a pricing  policy  in  which  the  price  does  not  depend 
on  the  state  of  the  system  will  be  referred  to  as  a state-independent  pricing  policy. 

The  state-dependent  pricing  framework  may  also  be  potentially  useful  as  an  internal- 
control  mechanism  for  many  not-for-profit  service  systems  (e.g.,  public-sector  and/or  military 
maintenance  facilities).  For  such  systems  state-dependent  pricing  would  have  the  effect  of  res- 
tricting services  to  more  urgent  needs  when  the  system  is  very  busy  and  encouraging  less 
urgent  needs  (e.g.,  preventive  maintenance)  when  the  system  is  relatively  idle.  Consequently, 
a better  and  more  balanced  utilization  of  the  system  is  likely  to  result.  Other  stochastic  systems 
such  as  consulting  firms,  job  shops,  and  bank  loan  services  also  fit  the  basic  description  of  such 
service  systems,  i.e.,  in  the  short  run  there  is  a constrained  amount  of  some  resource  which  can 
be  "rented",  because  of  the  stochastic  variations  in  the  state  of  the  system,  it  may  be  profitable 
to  follow  a state-dependent  pricing  policy  and  change  the  "rental  rate"  depending  on  the  current 
state  of  the  system.  For  brevity,  we  will  hereafter  refer  to  such  a stochastic  system  as  a "rental" 
system  and  refer  to  the  prices  as  "rental  rates"  although,  as  discussed  in  the  previous  examples, 
the  approach  is  general  enough  to  include  a variety  of  multiunit  stochastic  service  systems. 

In  practice,  state-dependent  pricing  is  observed  only  for  small  rental  systems,  where  the 
number  of  units  that  can  be  rented  or  the  total  amount  of  the  constrained  resource  than  can  be 
rented  is  small,  e.g.,  a consultant  (or  a small  consulting  firm)  quoting  different  rates  for  his 
consulting  services,  depending  on  how  busy  he  is,  or  small  firms  bidding  for  contracts.  (In  fact, 
the  bid  price  in  the  model  by  Kortanek,  Soden  and  Sodaro  [161  depends  explicitly  on  the 
"opportunity  cost"  of  the  constrained  resource.)  Generally,  we  do  not  find  that  big  car-rental 
agencies  or  motels  practice  state-dependent  pricing.  One  of  the  interesting  results  of  this  paper 
is  that,  as  the  number  of  units  for  rent  becomes  large,  the  optimal  state-dependent  pricing  pol- 
icy is  only  marginally  better  than  the  optimal  state-independent  policy.  This,  when  considered 
in  conjunction  with  the  disadvantages  of  the  state-dependent  policy,  such  as  greater  inventory- 
information  costs,  potential  customer  dissatisfaction,  and,  in  some  cases,  potential  legal  prob- 
lems (such  as  in  apartment  renting;  it  is,  however,  perfectly  legal  in  most  other  situations)  may 
explain  why  we  do  not  observe  state-dependent  pricing  for  "large"  rental  agencies. 

For  analytical  tractability,  we  shall  assume  that  the  return  time  of  each  rental  unit  in  our 
model  follows  an  exponential  distribution.  It  is  also  assumed  that  the  customers  arrive  accord- 
ing to  a Poisson  process.  However,  depending  on  the  rental  rate  (or  price),  the  customers  may 
elect  not  to  rent  a unit.  We  shall  start  our  analysis  with  the  assumption  that  the  rental  charge  is 
proportional  to  the  time  for  which  the  unit  is  out  on  rent.  Later,  we  shall  show  that  our 
analysis  carries  through  to  the  case  where  the  rental  price  is  the  sum  of  a fixed  charge  and  a 
variable  charge  that  is  proportional  to  the  rental  time. 

Our  model  may  be  characterized  as  a Markovian  decision  process  (or  Markov  renewal  pro- 
gram). A number  of  articles  have  been  published  in  this  area,  although  most  of  them  do  not 
deal  with  the  optimal-pricing  problem  we  are  considering;  for  instance,  see  Blackwell  [1,2], 
Denardo  [6],  Denardo  and  Fox  [7],  Derman  [8],  Fox  [9],  Howard  [12,13],  Jewell  [14],  Keilson 
[15],  Low  [17],  Ross  and  Lippman  [19],  and  references  cited  in  these  articles.  Except  for  Keil- 
son [15],  who  supplies  an  elegant  integer-programming  method  for  a single-unit  rental  system. 
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all  the  above  works  use  mainly  a dynamic-programming  approach  to  obtain  the  optimal  deci- 
sions. The  present  research  started  as  an  attempt  to  extend  Keilson’s  results  to  multiunit  rental 
systems.  The  results  reported  in  this  paper  are  related  to  those  of  Low  [17].  The  main 
differences  between  our  research  and  that  of  Low  are:  (i)  Low  uses  a lump  sum  (or  fixed 
charge)  payment  for  price,  while  we  assume  that  the  rental  charge  is  proportional  to  the  time 
for  which  the  unit  is  out  on  rent.  In  most  rental  and  similar  situations  (e.g.,  car  rentals,  com- 
puter processing,  or  bank  loans)  charges  are  proportional  to  the  rental-time;  i.e.,  a variable- 
charge  scheme  prevails.)  In  a later  section,  we  also  cover  the  general  case  of  a fixed  charge 
plus  a variable  charge  that  is  proportional  to  the  rental  time,  (ii)  Low  assumes  that  the  lump- 
sum prices  are  chosen  from  a fixed,  finite  number  of  available  prices,  while  we  allow  the  prices 
to  be  chosen  from  an  interval  (infinitely  many  choices).  (Low,  later  in  his  paper,  does  extend 
his  analysis  to  an  interval  as  the  decision  space,  but  he  avoids  the  discussion  of  computational 
problems.)  (iii)  Low  basically  uses  a dynamic-programming  approach,  while  our  approaches  are 
[>ased  on  nonlinear  programming  and  discrete  optimal-control.  Our  resulting  bounded-value 
difference  equations  can  be  solved  easily  to  yield  the  optimal  pricing  policies,  (iv)  We  obtain 
stronger  results  of  strict  monotonicity  of  the  optimal  prices,  while  Low’s  results  are  limited  to 
monotonicity  only,  (v)  We  provide  economic  insights  into  various  results. 

As  is  usual  in  the  Markovian  decision  problems,  we  are  interested  in  stationary  policies, 
i.e.,  policies  which,  although  state-dependent,  do  not  change  with  time.  The  existence  of  such 
policies  is  assured  in  our  case,  because  our  assumptions  satisfy  the  sufficient  conditions  as 
described  by  Fox  [9]. 

The  emphasis  of  this  paper  is  on  providing  a computationally  efficient  algorithm  for  the 
determination  of  optimal  state-dependent  rental  rates  as  well  as  on  offering  qualitative  insights 
into  the  problem  by  characterizing  some  important  properties  of  the  optimal  solution.  The 
basic  mathematical  programming  model  for  the  determination  of  optimal  state-dependent  prices 
is  formulated  in  Section  1.  Some  preliminary  properties  of  the  optimal  solution  are  derived  in 
Section  2.  Section  3 outlines  some  alternate  solution  strategies.  In  Section  4,  the  optimality 
conditions  are  derived  by  relaxation  of  one  of  the  constraints  of  the  mathematical  program. 
These  optimality  conditions  are  equivalent  to  the  solution  of  a nonlinear  difference  equation 
with  boundary  constraints,  and  they  ultimately  reduce  to  the  unique  intersection  of  two  curves 
monotonic  in  opposite  directions.  The  algorithm  determines  this  intersection  by  the  bisection, 
or  Bolzano,  search  [21,  p.  122].  Some  important  properties  of  the  optimal  solution  are  derived. 
An  alternate  solution  strategy  using  the  discrete-maximum  principle  of  optimal-control  theory 
[3,4]  is  developed  in  the  appendix  and  is  shown  to  result  in  the  same  set  of  optimality  condi- 
tions as  are  found  in  Section  4.  In  Section  5,  the  optimal  state-independent  solution  is 
explored,  and  the  results  are  compared  to  the  optimal  state-dependent  solution.  Finally,  some 
extensions  to  the  basic  model  are  explored  in  Section  6. 

1.  FORMULATION  OF  THE  STATE-DEPENDENT  PRICING  MODEL 

We  consider  a rental  system  with  k units.  Since  we  are  interested  only  in  the  short-term 
pricing  decisions,  the  number  of  units  k can  be  assumed  to  be  fixed.  Let  us  define  the  index 
sets: 


I 


K - {0,1,2 k }, 

K'  - {0,1,2 k -1),  and 

K"  - {1,2,  ....  *}. 
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The  return  of  the  rented  units  is  assumed  to  have  an  exponential  distribution  with  parameter  r j; 
i.e.,  the  service  time  for  a rented  unit  is  exponential,  with  mean  1/t).  The  customers  arrive  to 
inquire  about  the  rates  according  to  a Poisson  process  with  arrival  rate  A.  We  define  the 
parameter  p to  be 

p - A/tj,  (p  > 0). 

Customers  who  arrive  when  all  the  A units  are  busy  leave  (balk)  the  system  and  go  to  a com- 
petitor. Thus,  there  is  never  any  queue,  and  the  system  can  be  fully  described  by  the  number 
of  units  /'  (/€Af)  that  are  out  on  rent.  We  will  refer  to  / as  the  state  of  the  system.  Let 
v„  i€K\  be  the  rental  rate  charged  for  units  rented  when  the  system  is  at  state  i ; i.e.,  if  a unit 
is  rented  when  the  state  is  /,  and  the  unit  is  kept  for  t time  units,  then  the  rental  charge  will  be 
v,r.  Let  v denote  the  A-component  vector  with  elements  (v,).  The  probability  that  a customer 
who  arrives  will,  in  fact,  rent  a unit  is  modelled  as 

(1)  p(v()  - 1 - av„  for  i£K'  (a  > 0). 

Consequently,  if  v,  - 0 the  customer  will  rent  it  with  probability  one,  whereas  if  v,  becomes  as 
large  as  1 /a,  then  this  probability  drops  to  zero.  Thus,  (1)  models  the  traditional  downward- 
sloping  demand  curve.  In  order  that  0 < p(v,)  < 1,  we  require  that 

(2)  0 < v,  < 1/fl,  for  / € K'. 

The  problem  is  to  determine  the  optimal  values  for  the  k decision  variables 
v0,  V|,  v2,  ....  v*_,  so  as  to  maximize  D , the  expected  steady-state  revenue  of  the  rental  sys- 
tem per  unit  time. 

To  express  the  objective  D in  terms  of  the  decision  variables  (v,),  we  first  define  ir,  to  be 
the  steady-state  probability  that  the  system  will  be  in  state  / ( / € AO  corresponding  to  the  deci- 
sion vector  v.  Let  n denote  the  (A  l)-component  vector  with  elements  ir,.  Thus, 

(3)  ir,  3*  0.  for  / € K, 
and 

(4)  L */-  1- 

i€K 


To  express  the  ir' s in  terms  of  the  v,’s,  we  use  the  result  that,  in  steady  state,  the  upward  tran- 
sition rate  from  /'  to  / + 1 should  be  the  same  as  the  downward  transition  rate  from  / + 1 to  i 
for  /CAT'.  Since  A is  the  arrival  rate  and  p(v,)  is  the  probability  of  renting  a unit  given  an 
arrival,  the  effective  arrival  rate  is  A p(v,).  (Note  that  probabilistic  independence  has  been 
assumed  so  that  the  multiplication  operation  is  justified.)  Thus, 

(5)  7T,  A(1  - av,)  - *r;+1  (/  + l)t),  for  / € AT',  or 

7r,+1  - p(l  - a v ,)«■,/(/  + 1),  for  / € AT ' . 


i 


i 


1 

i 

i 


Consequently,  given  a set  of  (v,J  and  p,  the  (A  + 1)  values  {rr,}  can  be  determined  by  solving 
the  A equations  (5)  together  with  (4). 
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To  determine  D,  we  first  find  G (A/),  the  expected  revenue  accruing  from  the  rentals 
made  in  the  time  interval  (/,  t + Ar)  as  t — * oo  (note  that  in  steady  state  G depends  only  on  Ar 
and  not  on  t ),  so  that 

(6)  D - Lim  G(Ar)/Af. 

4/  —0 


To  compute  G( A/),  let  us  assume  for  the  moment  that  the  system  is  in  state  / at  time  t.  Then 
the  expected  number  of  units  rented  in  the  time  interval  (r,  t + Ar)  is  (AAf)  (1  - av,),  and 
for  each  unit  rented  at  rental  rate  v,  the  expected  service  time  is  1/tj,  so  that  the  revenue 
accruing  from  the  rentals  made  during  (/,  t + Ar)  is  (AAr)  (1  - av,)  (v,/t>).  Since  in  steady 
state  the  probability  that  the  system  will  be  in  state  / is  rr„  the  expected  revenue  accruing  from 
the  rentals  made  in  (r,  r + Ar)  is 

(?)  G(Ar)  — ]£  pv,(l  — av,)  ir,Ar. 

i€K' 

Finally,  using  (6)  we  obtain 

(8)  D - L pv,(l  - av,)  it,. 

UK' 

(A  more  rigorous  derivation  of  (8)  is  given  in  (10,  pp.  18-23].)  Consequently,  the  problem  of 
determining  the  optimal  {v,J  can  be  stated  as  Problem  Pq, 

(9)  Maximize  D(y)  - £ pv,(l  - av,)  it, 

r UK' 

subject  to 


(10) 


7r,+1  - p(l  - av,)  nj(i  + 1),  for  KK\ 


(ID  Z ni  “ D 

i(K 


D2)  it;  > 0,  for  /€AT, 

and 

(13)  0 < v,  <l/a.  for /€£'. 

To  reduce  the  number  of  parameters  of  the  system,  let  us  consider  the  transformed  decision 
variables  u - av  , i.e., 

(14)  w,  - av/(  for  i£K', 

and  maximize  F - aD  rather  than  the  objective  D (these  are  equivalent  to  changing  the  unit  of 
measurement  of  the  rental  rate  and  the  objective  function  by  the  same  factor  a)  so  as  to  obtain 
Problem  Pi, 
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(15) 

subject  to 

(16) 

(17) 

(18) 
and 
(19) 


Maximize  F( u)  - £ pm,(1  - u)n, 

• UK 


ir,+ 1 - p(l  - u,)irj(.i  + 1).  for  /€A', 

Zir-“  !- 

/ € K 


it,  > 0,  for  i € K, 


0 < u,  < 1,  for  /€A'. 


2.  SOME  PRELIMINARY  PROPERTIES  OF  THE  OPTIMAL  SOLUTION 

THEOREM  1:  There  exists  an  optimal  solution  u*to  Problem  P]  with  F*  - F(u*)  > 0. 

PROOF:  The  constraints  (16)  through  (19)  define  a compact  set  (closed  and  bounded)  in 
the  variables  (u,  n ).  The  constraint  set  is  nonempty,  since  u,  - 1/2,  for  i € K\  defines  a feasi- 
ble solution.  Consequently,  since  the  objective  function  (15)  is  continuous  in  (u,  if),  there 
exists  an  optimum  solution  to  Problem  P,.  Now  it  is  easily  verified  that  for  the  feasible  solu- 
tion u,  - 1/2,  for  i€  K\  if  > (T  and  F > 0.  Consequently  F*  > 0. 


COROLLARY  1:  For  any  optimal  solution  u*,  «0*  < 1- 

PROOF:  Assume  the  contrary,  that  u‘0  - 1.  From  (16)  through  (18)  it  is  easily  verified 

that  ir,'=0  for  / - 1,2 k.  From  (15)  it  then  follows  that  F*  = 0,  which  contradicts 

Theorem  1. 

To  prove  the  other  important  properties  of  the  optimal  solution,  we  reformulate  Problem 
Pt  in  terms  of  only  the  decision  variables  u.  From  (16), 

(20)  it,  ~ no  (p'/'D  ft  (1  _ uj ) for  , 

/-  o 


-t 

where  we  follow  the  usual  convention  that  (1  — uj)  — 1. 

./- o 

Consequently,  from  (17)  it  follows  that 


(21) 

Substituting 

P* 


1T0  ~ 1/ 


I 


(p'/z!)  n (i  - u/) 


1(6  AT  7-0  J 

(20)  and  (21)  in  the  objective  function  (15),  Problem  Pi  is  equivalent  to  Problem 
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(22) 


subject  to 


(23) 


Maximize  F(u) 

a 


I (p'+y»!)  Ui  na- «/) 

I € AT' y-o 

I (p '//"!)  fi  (1  - My) 

>€*  /-0 


0 < m,  < 1,  for  / € AT'. 


THEOREM  2:  Any  optimal  solution  u*to  Problem  P\  (or  P2)  has  the  property  that  u’  < 
1 for  /€*'. 

PROOF:  Assume  the  contrary.  Let  m be  the  smallest  index  for  which  u'm  — 1.  Corollary 
1 implies  that  m > 1.  Thus  u-  < 1 for  0 < / < m— 1.  From  (22)  it  is  seen  that  the  objective 
Fis  independent  of  the  values  of  w,’for  / > m.  Therefore,  without  loss  of  generality  the  values 
u' - 1 can  be  assigned  to  the  states  / > m.  For  this  u *,  (22)  becomes 


m — \ 


(24) 


Defining 


F(u*)  - 


and 


i (p,+,//o «;  n (i  - «;> 

0 1-0 

z (p’/'!)  no- «/) 

/-0  y-0 


^ - mz  (p'+i//o  «;n  (!-«,*) 

1-0  /-0 


* - i (p'/z!)  'fi  o - «;>. 

i—o  y-o 


we  can  rewrite  (24)  as 


(25) 


F(u ’)  - /4/a 


In  the  above  expression  for  a,  the  term  for  / — 0 simplifies  to  unity.  Renumbering  the  remain- 
ing indices  i — .1,2,  ....  m to  / — 0, 1,2,  ...  m - 1,  we  get 


m-1 


a-i  + i ip'+'/o+Di]  no  -«/)• 

i-o  y-o 

Now  consider  a solution  u'  which  is  identical  to  u * in  all  its  components,  except 


(26) 


u’m  - ll/(m  + 1)1  + max  l u,*(i  + 1 )/(m  + 1)] 

o < , < m - i 


1 

] 

I 

I ! 
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Since  0 < u*  < 1 for  0 < / < m - 1,  it  follows  that  the  term  within  the  braces  is,  strictly,  less 
than  m/(m  + 1),  so  that  0 < u'm  < 1.  For  the  solution  u', 

(27)  F(u')  - (A  + C)/(B  + D). 

where  A and  B are  as  defined  before,  and 


c - (pm+i/(w!)  u'„  (i  -u'j  n n - "/) 

7-0 


and 


D - [p"+V(«  + 1)!1  (1  - u'J  mn‘  (1  - «/)• 

7-0 


Note  that  F(u)  > F(u*)  iff  (A  + C)/(B  + D)  > A/Bot  iff  C/D  > A/B  or  iff  B (C/D)  - 
A > 0,  since  A,B,C , and  D are  all  strictly  positive.  Since  C/D  - (m  + 1)  u'm,  it  follows  that 

(28) 

B(C/D)  -A-(rn+\)um  + m£  {[p/+,/(/  + l)!l  (m  +l)u'm  - (pi+'/i\)u,'\  n (1  - «/)• 

/-0  7-0 


which  is  strictly  positive,  since  [«'m  (m  + l)/(/  + 1)1  — «,*  > 0,  from  (26),  for 

0 < / < m - 1.  Thus  we  obtain  F(u')  > F(u*),  which  contradicts  the  statement  that  u*is  an 
optimal  solution. 

Intuitively,  a charge  U/  - 1 would  mean  that  no  customers  would  rent  when  the  system  is 
at  state  i (recall  that  the  probability  that  a customer  who  arrives  will,  in  fact,  rent  is 
p — 1 — u),  so  that  (k  — i)  rental  units  will  always  be  idle.  In  other  words,  a firm  with  / units 
would  make  the  same  average  revenue  as  another  firm  with  the  same  X and  tj  but  with  k > i 
units,  which  does  not  make  sense  in  a stochastic  environment. 

COROLLARY  2:  For  any  optimal  solution  to  P\  (or  PJ,  n,'  > 0,  for  / € A. 

PROOF:  The  proof  follows  directly  from  Theorem  2 and  equations  (20)  and  (21). 

3.  SOLUTION  STRATEGIES 

Several  solution  strategies  suggest  themselves  for  obtaining  the  optimal  u*.  Problem  P{ 
can  be  solved  directly  as  a nonlinear  program  by  the  gradient-projection  method  (11,  pp.  328- 
331].  But  since  the  nonlinear  constraints  (16)  have  to  hold  as  strict  equalities,  one  can  not 
guarantee  that  the  procedure  would  find  the  global  optimum.  Similarly,  if  we  solve  Problem  P2 
by  the  gradient  method  (11,  pp.  296-315],  there  is  no  guarantee  that  we  will  obtain  the  global 
optimum  solution,  since  we  have  not  been  able  to  prove  that  the  objective  (22)  is  at  least  pseu- 
doconcave in  u. 


r 

. - 
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Problem  Px  can  be  formulated  as  a dynamic  program  if  we  define  tt,  as  a state  variable. 

k 

To  incorporate  the  constraints  (17)  and  (18),  we  define  s,  - £ itj  as  the  second  state  variable 

i-i 

with  s0  - 1.  At  stage  i,  0 < / - 1, 

(i)  State-Space:  {(w,,  s,):  0 < tt,  < s,  and  0 < s,  < 1). 

(ii)  Stage-Transformation:  ir,+1  - p(l  - «,)  it  ,-/(/'  + 1)  and  s,+1  - s,  - w,. 

(iii)  Decision  Space:  {«,:  0 < < 1}. 

(iv)  Performance  Index:  f(uit  it)  - pu,  (1  - 

(v)  Functional  Equation: 

T,(n,,  Si)  - Max  lf(u,,  n,)  + 7;+,  (7r,+1>  s,+1)], 


I 0 if  irk  - sk, 

where  T*  Or*.  sk)  = ( _ „ otherwjse 

The  dynamic  programming  procedure  starts  from  stage  k - 1 and  proceeds  backward  to 
stage  0.  The  optimum  solution  to  Problem  P,  is  given  by  the  maximum  of  T0(n 0, 1)  over  all 
n0  such  that  0 ^ tt0  < 1 . 

Although  the  dynamic  programming  procedure  is  easily  formulated,  it  is  computationally 
tedious,  since  it  involves  two  continuous  state  variables.  A more  efficient  computational  pro- 
cedure is  presented  in  the  next  section. 

4.  PROPERTIES  OF  THE  OPTIMAL  SOLUTION  AND  AN  ALGORITHM 
4.1.  Optimality  Conditions 

In  this  section,  we  first  reformulate  Problem  P,  using  only  the  {irj  variables.  By  Corol- 
lary 2,  we  can  restrict  our  attention  to  only  those  solutions  for  which  n > U Given  n,  > 0,  we 
can  rewrite  (16)  as 


F(u)  — P(rr)  — £ (/  + 1)  7r,+|  {1  — [(/'  + l)ir,+i/(pir,)]). 

i€K' 

Consequently,  under  the  conditions  that  7r,  > 0 for  /'  € AT,  we  can  rewrite  (15)  through  (19)  as 
Problem  P3, 


(29)  p(l  - «,)  ir,  = (/  + 1)  rr,+ 1,  for  i€K\ 
so  that 

(30)  u, • - 1 - [(/  + 1)  ir i+\/(pn ,)],  for  / € AT ' . 
Substituting  (29)  and  (30)  in  (15),  we  get 
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L (w,  0)  - X in,  {1  - l/w,/(pff,_|)]}  - 0 ||  X ~ 1 j- 

From  Kuhn-Tucker  theory  [18]  we  obtain  the  following  necessary  and  sufficient  (because  of 
concavity)  conditions  for  optimality: 

(35)  (i)  BL/Bir,  — 0 for  / € AT, 

(36)  (ii)  X »/  “ !. 

ifK 

(37)  (iii)  w,  > 0 for  itK, 


(iv)  0 unrestricted  in  sign. 

Inequalities  (37)  (the  same  as  (33))  permit  us  to  define  z,  — ir Jit, _|,  for  /EAT”,  so  that  the 
(k  + 1)  conditions  of  (35)  become 


z i “ Op 


ip  — 2/'2z,  + (/'  + l)2  Zj+|  — 0p,  for  i — 1,2  , k — 1, 


(40)  kp  — 2 k2z*  — Op. 

Thus,  we  seek  a solution  satisfying  (36)  through  (40).  We  now  explore  some  properties  of 
such  a solution. 

4.2.  Properties  of  the  Optimal  Solution 

THEOREM  5.  Suppose  that  (ir,  9)  satisfies  the  conditions  (36)  through  (40).  Then  0 — 


PROOF:  Multiplying  (38)  through  (40)  by  the  respective  n/s  ( recall  that  z,  - «-,/«•, _|) 
and  summing,  we  obtain 


(iriVn-fl)  + X I,P7ri  ~ 2/'2(ir 2/7r,_,)  + (/'  + l)2(rr,\|/rr,)] 
/-i 


+ kprr*  - 2k2(ir^/irt_,)  - 0p  X 

ICK 
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Expanding  and  rearranging  the  terms  on  the  left-hand  side,  we  obtain 

£ p/>,  |1  - l/'ir//(pir(_|)]J  -#p  £ it,  - Op. 
<€*"  UK 


Dividing  throughout  by  p and  using  (31),  we  obtain  the  desired  result. 


Q.E.D. 


To  find  the  solution  to  (36)  through  (40),  we  first  observe  that  (37)  can  be  rewritten  as 
(41)  z,  - Tr,/ir,_|  > 0,  for  i€K". 

In  the  appendix  we  show  that  conditions  (38)  through  (41),  (30),  and  (34)  also  result  from  a 
discrete  optimal-control  approach  [3,4]  to  solving  Problem  Px. 

From  (36)  and  (41)  it  follows  that 


rr,  - toll  zi‘  for  '€Af, 

i- 1 


*0-1/ 

UK  J- 1 


where  we  use  the  convention  n*/-i  Consequently,  the  Ac-component  vector  z - {zj  satis- 

7-1 

fying  (38)  through  (41)  (and  the  corresponding  [it,)  defined  by  (42)  and  (43))  satisfies  the 
Kuhn-Tucker  conditions  for  the  problem  of  maximizing  (31)  subject  to  (32)  and  (33).  From 
(38)  and  (41)  it  is  clear  that  0 has  to  be  nonnegative  for  the  conditions  (38)  through  (41)  to  be 
satisfied. 

To  solve  the'system  (38)  through  (41),  we  first  define 


z0  “ 0, 


so  that,  by  setting  tv,  - z 2 in  (38)  and  (39),  we  obtain 

(45)  w/+,  - [(9  - /)  p + 2 /2z  ,]/(/  + 1)J,  for  / - 0, 1,2,  ....  A:  - 1. 

If  the  values  of  0 and  z,  are  such  that  the  value  for  h,,+1  obtained  in  (45)  is  nonnegative,  then 

(46)  z/+1  - + (w,+1) 1/2  for  / - 0, 1 , 2 k - 1 . 

Consequently,  the  system  of  equations  (38)  through  (41)  may  be  solved  as  follows: 
Given  a value  of  0 >0,  we  set  z0  - 0 (44)  and  determine  W|  from  (45)  and  Z|  from  (46).  In 
general,  for  i - 0,1,2,  ....  k - 1,  given  z,  we  compute  **>,+,  using  (45),  and  if  is  nonne- 
gative, we  compute  z,+I  from  (46).  From  now  on,  this  process  of  generating  zt,  z2 z* 


. _ 
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will  be  referred  to  as  the  forward-recursion  procedure.  In  Theorem  6 below  we  show  that  for 
each  i - 1,2,  ...  k there  exists  a 0,  such  that  w,(9)  > 0 for  0 > 9r  Thus,  2,(9)  is  well  defined 
for  9 > 9,.  Furthermore,  it  will  be  shown  that  for  9 > 9n  z,(9)  is  strictly  positive,  strictly 
increasing,  and  strictly  concave  in  9 for  / - 1,2,  . . . , k.  In  particular,  the  above  statements 
hold  for  zk(9),  9 > 9k,  so  that  zk(9)  can  be  pictorially  represented  as  curve  A in  Figure  1. 


*kOR  iki 


VALUE  OF  zk  OBTAINED  BY 
FORWARD  RECURSION 
■ IEQ.  (44)  - (46)) 


zk  DETERMINED  BY  EO.  (47) 


Figure).  Determination  of  0* 

Now  let  us  consider  (40).  To  distinguish  the  zk  obtained  by  the  forward-recursion  procedure 
from  the  zk  obtained  from  (40),  we  will  call  the  latter  £*(0),  so  that 

(47)  £*,(0)  - (Ar  - 0) p/ (2k2). 

Thus,  zk  (9)  is  a linear  and  strictly  decreasing  function  of  0,  as  shown  by  line  B in  Figure  1. 
The  value  of  0-0*  satisfying  (38)  through  (41)  is  thus  obtained  as  the  unique  intersection 
point  of  these  two  monotone  functions  of  0 monotonic  in  opposite  directions  (curve  A and  line 
B),  as  shown  in  Figure  1.  The  point  0*can  be  found  by  the  bisection  (or  Bolzano)  search  [21, 
p.  122)  by  searching  in  the  region  0€[O,  A).  Later,  in  Theorem  7,  we  shall  prove  the  unique 
existence  of  0 * and  determine  tighter  bounds  on  0 * so  as  to  reduce  the  search  effort.  Once  the 
value  0*  is  determined,  the  zfs  for  i 6 K can  be  determined  from  (44)  through  (46),  the  it's 
for  /€Af  from  (42)  and  (43)  and  the  u's  for  / € AT'  from  (30).  In  the  lemmas  and  theorems 
below  we  denote  the  first  and  second  derivatives  with  respect  to  0 by  ' and  " respectively. 

LEMMA  V.  Consider  the  w,(0)  and  z,(0),  for  / — 1,2,  ...  , k,  obtained  by  the  forward- 
recursion  procedure.  Suppose  there  exists  a 0,  such  that,  for  0 > 0„  w,(9)  > 0,  w\(0)  > 0, 
and  w'\  (9)  < 0.  Then,  for  0 > 0„  2,(0)  > 0,  z',(0)  > 0,  and  z'  ,(0)  < 0. 
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PROOF:  From  (46), 
*f(0)  - + (",(«)] 1/2, 


z',(0)  - [w,(0)]-'/2  h-',(0)/2, 

and 

z",«»  - - [wm~in  wmv*  + h-",(0)/2. 

Lemma  1 follows  immediately  from  the  above  three  equations. 

THEOREM  6:  There  exist  {0,},  for  / € K,  with  9 , < 9j  for  i < j,  such  that  for  each 
itK",  w,(9)  and  z,(0)  generated  by  the  forward-recursion  procedure  are  well  defined  for 
9 ^ 0,_i  and  0 > 0„  respectively,  with  tv,(0,)  - z,(0,)  - 0.  Both  w,(0)  and  z,(0)  are  of  C “ 
(i.e.,  continuous  functions  with  continuous  first  and  higher-order  derivatives)  for  0 > 0,_,  and 
0 > 0,  respectively.  Furthermore,  in  the  same  open  intervals,  w',(0)  and  z',(0)  are  strictly 
positive  and  w"/(0)  and  z",(0)  are  strictly  negative,  except  that  w'',(0)  - 0.  Thus,  z,(0)  is  a 
strictly  positive,  strictly  increasing,  and  strictly  concave  function  for  0 > 0,. 

PROOF:  We  prove  Theorem  6 by  induction.  From  (44)  and  (45),  h>,(0)  - Op,  so  that  if 
we  define  0O  to  be  any  number  such  that  - oo  < gQ  < o and  0,-0  and  apply  (46)  and  Lemma 
1,  the  assertions  of  Theorem  6 are  readily  verified  for  w,  and  z,. 

Since  z,(0)  is  well  defined  for  9 > 0,  and  is  of  C“  for  0 > 0,,  so  is  w2(0),  from  (45). 
Note  that 

w'2  (0)  - [p  + 2z',(0)]/4 
and 

w"j(0)  - z",(0)/2. 

Since  z',(0)  > 0 and  z'',(0)  < 0 for  0 > 0,,  it  follows  that  w'2(0)  > 0 and  w "2(0)  < 0 for 
0 > 0,.  Thus,  w2(0)  is  a continuous,  strictly  increasing,  and  strictly  concave  function  for 
0 > 0,.  From  (45),  w2(0)  > 0 when  0 is  sufficiently  large,  but  w2(0,)  < 0,  since  0,-0  and 
z, (0,)  - 0.  Thus,  there  exists  a unique  02  > 0,  such  that  w2(02)  -0  and  w2(0)  > 0 for 
0 > 02.  Consequently,  from  (46),  z2(0)  is  well  defiaed  for  0 > 02  and  is  of  C°°  tor  0 > 02. 
Furthermore,  w'2(0)  > 0 and  w"2(0)  < 0 for  0 > 02,  since  these  statements  have  already  been 
shown  to  hold  for  0 > 0,,  and  02  > 0,.  From  Lemma  1 it  follows  that  z2(0)  > 0,  z'2(0)  > 0, 
and  z"2(0)  < 0 for  0 > 02. 

So  far,  we  have  established  the  existence  of  9,  for  i -0,1,2  satisfying  the  conditions  of 
Theorem  6.  For  the  general  induction  step,  we  assume  that  we  have  proved  the  existence  of  9, 
for  / - 0,1  ...  , m < k (m  >2)  satisfying  the  assertions  of  the  theorem.  To  complete  the 
proof,  we  want  to  show  that  0m+,  > 0m  also  exists,  satisfying  the  conditions  of  the  theorem. 

Since  zm{9)  is  well  defined  for  0 > 9m  and  is  of  C “ for  0 > 0m,  so  is  wm+,(0)  (see 
(45)).  From  (45)  and  the  induction  hypothesis  on  zm(0),  we  have,  for  0 > 9m, 


4 

> 

- 

» 

t 


! 

i 

i 

i 


t 


POLIC!^  FOR  STOCHASTIC  SERVICE  SYSTEMS 


271 


(0)  - [p  + 2rn2z'm(0)]/(«  + l)2  > 0 


(0)/(m  + l)2  < 0 


Thus,  wm+|(0)  is  continuous,  strictly  increasing,  and  strictly  concave  for  0 > 9m.  Furthermore, 
from  (45),  and  since  zm(0m)  - 0, 


Applying  (45),  for  / - m — 1,  we  obtain. 

(49)  >vm(0m)  - 0 - l(0m  - m + 1)  p + 2(m 


since  zm_,(0m)  > 0 Um_1(0„_))  - 0,  9m  > 0m_,  and  zm_,(0)  is  strictly  increasing  for 
0 > 0m_il.  From  (48)  and  (49),  wm+,(0m)  < 0.  From  (45)  it  is  clear  that  wm+1(0)  > 0 for 
sufficiently  large  0.  Since  wm+,(0)  is  continuous  and  strictly  increasing  for  9 > 9m,  there  exists 
a unique  0m+,  > 9m  such  that  wm+l(0m+1)  - 0 and  wm+1(0)  > 0 for  0 > 0m+1.  Consequently, 
from  (46),  zm+i(0)  is  well  defined  for  0 > 0m+,  and  is  of  C“  for  0 > 0m+).  Furthermore, 
*v'm+1(0)  > 0 and  w”m+,  (0)  < 0 for  0 > 0m+ 1,  since  these  statements  have  already  been 
shown  to  hold  for  9 > 9m  and  since  0m+1  > 0m.  From  Lemma  1 it  follows  that  zm+1(0)  > 0, 
z'm+ 1(9)  > and  z"m+,(0)  < 0 for  0 > 0m+i,  thus  completing  the  induction  proof. 


LEMMA  2:  The  (0/)  for  /€  K defined  in  Theorem  6 satisfy  the  condition  that  0,  < i. 


PROOF:  The  values  0O  < 0 and  0,-0  obviously  satisfy  the  condition  for  / 
1,  respectively.  For  i - 2, 

w2(0)-[(0-l)p  + 2z,]/4, 


Since  2 > 0t  - 0,  from  Theorem  6 it  follows  that  z,(2)  > 0,  and  hence  w2(2)  > 0.  Since 
w}(02)  — 0 and  w2(0)  is  strictly  increasing  for  0 > 02,  it  follows  that  02  < 2.  Let  us  now 

assume  that  the  assertion  0,  < i has  been  established  for  i - 0,  1,2 m < k (m  >2). 

To  complete  the  induction  proof,  we  show  that  6m+]  < (m  + 1).  From  (45), 

H'«+|(m  + 1)  - Ip  + 2 mhm(m  + l)]/(m  + l)2. 


Now,  from  Theorem  6,  zm(0m)  - 0 and  zm(0)  > 0 for  0 > 0m.  Consequently,  zm(m  + 1)  > 
0,  since  (m  + 1)  > m > 9m  by  the  induction  hypothesis.  Thus,  wm+1(w  + 1)  > 0.  Since 
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H'm+|(0«+|)  " o and  wm+|(0)  is  strictly  increasing  for  0 > 0„,+1,  it  follows  that 
0m+i  < (m  + 1),  thus  completing  the  proof. 

LEMMA  3:  In  the  forward-recursion  procedure 
(50)  z, (p/4)  -p/2/,  for  /€ K". 

PROOF:  For  / - 1,  from  (44)  and  (45),  w t (p/4)  - (p2/ 4),  so  that,  from  (46), 

7,(p/4) - + (pJ/4) 1/2 -p/2,  :■ 

thus  verifying  the  assertion  for  / - 1.  For  / - 2,  (45)  with  0 - p/4  yields 
6 (p/4)  - (k  - p/4)  (p/2/r2)  — p/2/c  - — p2/8fc 2 < 0. 


so  that,  from  (46),  z2(p/i)  - p/4,  verifying  (50)  for  / — 2. 

To  prove  the  general  induction  step,  we  assume  that  (50)  has  been  shown  to  hold  for 
i " 1.2,  ....  m < k,  where  m > 2.  We  now  prove  that  (50)  holds  for  / — m + 1 also.  For 
/ - m + 1,  (45),  with  0 - p/4,  yields 

H’m+i(p/4)  - U(p/4)  - m]  p + 2m2(p/2m))/(m  + l)2 
-P2/I4(m  + l)2]. 

Consequently,  from  (46),  rm+)(p/4)  — p/2(m  + 1),  as  was  to  be  proved. 

We  now  prove  the  (unique)  existence  of  0*  satisfying  (38)  through  (41)  and  show  that 
the  solution  corresponding  to  0*  solves  Pv 

THEOREM  7:  (A)  There  exists  a unique  0*  < min(p/4,Ar)  which  satisfies  (38)  through 
(41).  (B)  The  corresponding  |z/)  satisfying  (38)  through  (41)  also  satisfy  (34).  (Recall  that 
Z;  ” ir,/ir,_|.)  (C)  The  associated  ir,  for  / 6 K (see  (42)  and  (43))  is  the  unique  optimal  solu- 
tion to  Problem  F3,  (31)  through  (34).  (D)  The  corresponding  solution  (w/j  for  UK'  obtained 
from  (30)  is  optimal  to  /*,,  (15)  through  (19). 

PROOF:  We  first  note  that  once  (A)  and  (B)  are  proved,  (C)  and  (D)  follow  immedi- 
ately from  our  earlier  development. 

In  order  to  prove  (A),  we  first  show  the  (unique)  existence  of  0*  < k.  Let  us  define 
(51)  h (0)  — f*(0)  — zk(0), 

where  zk(0)  is  given  by  (47)  and  z*(0)  is  obtained  by  the  forward  recursion.  Recall  from 
Theorem  6 that  zk{0)  is  well  defined  for  0 > 0*  and  z*(0)  is  of  C°°,  strictly  positive,  and 
strictly  increasing  for  0 > 0k.  Since  z*(0)  is  well  defined  and  strictly  decreasing  for  all  0,  6(0) 
is  well  defined  and  strictly  decreasing  for  0 > 0k.  Note  also  that  6(0)  is  continuous  for 
0 > 0k,  since  both  of  its  component  functions  are  continuous.  Conditions  (38)  through  (41) 
will  be  satisfied  at  0*  iff  0*  > 0k  and  6(0*)  - 0. 
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From  Lemma  2,  9k  < *.  Consequently,  h(9k)  - zk(9k)  > 0,  since  zk(9)  is  strictly 
decreasing  and  z*(*)  — 0.  Similarly  h (*)  — — zk(k)  < 0,  since  zk  is  strictly  increasing  and 
zk  (#*)  “ 0.  By  continuity  and  the  strictly  decreasing  nature  of  h(9),  it  follows  that  there  exists 
a unique  0*such  that  h{9*)  - 0,  where  9k  < 9*  < k.  Such  a 9 * then  satisfies  (38)  through 
(41). 


To  prove  that  9*  < min  {p/4, *},  it  is  enough  to  show  that  9*  < p/4,  since  we  have  just 
shown  that  9*  < k.  By  Lemma  3,  z*(p/4)  - p/2  it,  so  that 

Mp/4)  - (*  - p/4)  (p/2*2)  - p/2*  - - p2/8*2  < 0. 

Since  h is  strictly  decreasing  and  h(9*)  - 0,  it  must  be  that  9*  < p/4,  thus  completing  the 
proof  of  (A). 

To  prove  (B),  we  first  note  from  Lemma  3 that  z,(p/4)  - p/2/.  From  part  (A)  of  the 
theorem,  9*  < p/4.  Consequently,  by  the  strictly  increasing  nature  of  z,(0)  (see  Theorem  6)  it 
follows  that 

(52)  ir'/it ,1,  - z,’-  z,(9*)  < z,(p/4)  - p/2i  < p/i, 


thus  satisfying  (34).  Q.E.D. 

Theorems  6 and  7 establish  that  the  solution  procedure  pictorially  represented  in  Figure  1 
does  yield  an  optimum  solution  to  Problem  Pit  and  hence  to  P\.  This  solution  procedure  is 
detailed  as  Algorithm  1 below.  Before  presenting  the  algorithm,  however,  we  prove  the  intui- 
tively pleasing  result  that  Uq  < u[  < u[  < . . . < uk_{\  i.e.,  when  more  units  are  out  on  rent, 
we  would  like  to  charge  a higher  price.  The  theorem  also  shows  that  u * < 1 (cf.  Theorem  2) 
and  that  u * > 1/2.  The  result  that  u’  > 1/2  makes  intuitive  sense,  since  we  will  later  show 
(cf.  Theorem  9)  that,  as  * -»  oo  (unconstrained  resource),  the  optimal  solution  is  u,‘—  1/2,  so 
that  when  * is  finite  (i.e.,  resource  is  constrained)  the  opportunity  cost  of  the  resource  (cf. 
[16])  would  make  u'  > 1/2. 

THEOREM  8:  The  optimal  solution  (u,l,  for  / € AT',  to  P\  satisfies  the  property 

(53)  1/2  < Uq  <•*/,*  < ...  < < 1. 

PROOF:  We  prove  this  theorem  in  two  parts.  We  first  show  that  1/2  < u'  < 1 for 
/€ AT'.  We  then  prove  that  u'  < m,*+i  for  / - 0, 1,2,  ....  * - 2. 

From  (30),  recalling  that  z,+,  — n'+i/n’, 

(54)  «/*-  1 - (/  + l)z/+I  Ip  - 1 - (/  + l)z,+,(0*)/p. 

From  Theorem  7(A),  9k  < 9*  < min  {p/4,  *}.  Furthermore,  from  Theorem  6,  z,+i(0)  is 
strictly  increasing  in  9 for  9 > 0,+1.  Consequently, 

(55)  «,*  < 1 - </  + l)z,+I(0*)/p  <!-(/  + l)z,+1(0(+1)/p  - 1. 
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since  Oi+i  < Ok,  from  Theorem  6.  (The  equality  holds  when  / * k — 1.)  Futhermore,  from 
the  fact  that  0 • < p/4  and  Lemma  3 it  follows  that 


«/  > 1 - (/  + 1)  z(+1  (p/4)/p  - 1 - 1/2  - 1/2 


From  (55)  and  (56)  it  follows  that  1/2  < u’  < I for  i£K'. 


To  show  that  «/_,  < u‘  for  / 
tion  holds  if  and  only  if 


We  prove  (57)  by  induction.  For  / - 1,  we  get  from  (38)  and  (39) 


P - 2z{  - 2((p/2)  - z{)  > 0 


since,  from  (52),  Z|(0*)  < p/2.  Consequently,  z,'2  > 4z2*2,  or  z[  > 2 zj,  since  z,*  > 0,  for 
/€* ",  at  the  optimum  (see  (41)).  Thus,  (57)  holds  for  / - 1. 


since,  from  (52),  z2(0‘)  < p/4  and  z,‘  > 2z2,  as  shown  earlier.  Consequently,  4z22  > 9zj2, 
2zj  > 3zj,  since  all  the  z's  are  strictly  positive  at  the  optimum.  Thus,  (57)  holds  for  / - 2. 

For  the  general  induction  step,  we  assume  that  (57)  holds  for  / - 1,2 m - 1 

(k  - 2),  where  (m  - 1)  > 2.  We  prove  below  that  m z*  > (m  + 1)  zj)+1.  From  (39) 
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since  z'm  < p/2m.  from  (52),  and  (m  — 1)  z*_j  > mz'„,  by  the  induction  assumption.  Thus 
m2z^2  > (m  + l)2  2;2+l,  or  mz'm  > (m  + 1)  z^+|,  since  the  z's  are  strictly  positive  at  the 
optimum  (see  (41)),  thus  completing  the  proof. 

4.3.  The  Algorithm 

We  now  provide  Algorithm  1,  based  on  the  forward-recursion  procedure  discussed  earlier, 
using  the  bisection  search  to  identify  0 *.  From  Theorem  7,  0 * < 0m„,  where 

(58)  0m„  - Min  (p/4,  *}. 

Furthermore,  by  Theorem  5 and  from  the  fact  that  u - (u,  - 1/2)  defines  a feasible  solution, 
we  can  set 

(39)  9*  2 9min  - F(fi)  > 0. 

ALGORITHM  1:  To  find  the  optimal  u*to  P\. 

STEP  0:  Define  0m„  and  0min  as  per  (58)  and  (59).  Set  9 - (0min  + 0m„)/2. 

STEP  1:  Set  z0-0.  Using  (45)  and  (46)  recursively,  compute  w1,w2 w*  and 

zi,  z2 z*.  Each  time  a w,  is  computed,  check  to  see  whether  w,  < 0.  If  w,  < 0,  replace 

0min  by  the  current  value  of  0,  and  go  to  Step  2.  If  w,  is  0 for  all  go  to  Step  3. 

STEP  2:  Set  0 - (0min  + 0m„)/2.  Go  to  Step  1. 

STEP  3:  Calculate  zk(9)  from  (47).  Compare  it  with  z*(0)  computed  from  Step  1.  If 
either  of  the  stopping  rules  below  is  satisfied,  go  to  Step  4.  If  not,  go  to  Step  5. 


Stopping  Rules 

(A)  |z*  - z*|  < Ex>  where  Ex  is  a prespecified  small  number. 

(B)  (0m„  - 0min)  < £2,  where  E2  denotes  the  maximum  precision  for  computational  pur- 
poses. 

STEP  4:  If  stopped  by  Rule  (A),  compute  W')  from  the  (z,),  using  (42)  and  (43)  and  u' 
from  (30).  The  "optimal*  value  F(u*)  - 0*,  where  0*  is  the  current  value  of  0.  STOP.  If 
stopped  by  Rule  (B),  higher  precision  is  required  for  the  computations.  Multiprecision  routines 
can  be  used  for  this  purpose.  STOP. 

STEP  5:  If  zk  > zk,  replace  0m„  by  the  current  0,  and  go  to  Step  2.  If  zk  < zk,  replace 
0mjn  by  the  current  0,  and  go  to  Step  2. 

It  is  easily  seen  that  at  each  iteration  the  search  interval  is  reduced  to  half  of  its  original 
size,  and  hence  the  algorithm  will  terminate  in  a finite  number  of  steps  for  any  strictly  positive 
precision  parameter  £2- 

4.4  Computational  Experience 

A total  of  48  test  problems  were  solved  by  Algorithm  1 for  each  combination  of  the 
parameter  values  given  below: 
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(i)  * - 2,  5,  10,  15,  20,  40; 

(ii) p/*  - 0.2,  0.5,  1,  2,  3,  4,  5,  6. 

The  values  of  p/ k above  were  chosen  with  a view  to  keeping  the  problem  within  realistic  limits. 
Any  real  system,  it  was  felt,  would  not  have  too  high  an  "all  idle"  probability  ir0  or  too  high  an 
"all  rented  out"  probability  irk.  The  values  of  p/k  given  above  approximately  meet  an  upper 
limit  of  0.2  on  the  probabilities  ir0  and  nk.  The  parameter  E\  was  set  equal  to  10-5,  and  £2 
was  set  to  correspond  to  double-precision  arithmetic  on  the  IBM  360/65  computer 
(£2  = 10"15).  The  48  problems  were  all  solved  in  a total  of  24.7  seconds  (=  0.5  s per  prob- 
lem; the  program  was  compiled  on  FORTRAN  G).  However,  two  of  the  48  problems  had  to 
be  terminated  because  of  stopping  rule  (B),  i.e.,  the  double  precision  was  not  sufficient. 

5.  STATE-INDEPENDENT  PRICING  POLICIES. 

Let  u denote  the  rental  rate  that  is  independent  of  the  state  of  the  system.  Problem  P4 
for  determining  the  optimal  u is  a special  case  of  Problem  P2,  (22)  and  (23).  Replacing  (u,J, 
for  /'  € A",  by  «,  we  obtain  Problem  /%: 


Maximize  Q(u) 


subject  to 


£ U»M/1 0 u(l  - u)‘ 

iJJC 

£ (p'//l)  (1  - «)' 

UK 


0 < u < 1. 


The  objective  Q(u)  in  (60)  can  be  rewritten  as 


where 


Q(u ) - pu  (1  - u ) (£*_,/£*). 


Ej  - £ (p'/z!)  (1  — «)' 


The  following  theorem  gives  the  main  properties  of  the  optimal  solution  u*  and  its  rela- 
tionship to  the  optimal  state-dependent  pricing  solution  {u/}. 

THEOREM  9:  (A)  0 < u*  < 1. 

(B)  If  k — > oo,  then  u*  - 1/2  uniquely  solves  P4. 

(C)  If  k — oo,  then  u'  — 1/2,  for  »€AT',  is  also  an  optimal  state-dependent  pricing  policy, 
i.e.,  it  solves  P}. 


PROOF:  (A)  When  u —• ► 0 or  1,  numerator  of  Q{u)  in  (60)  also  tends  to  zero,  while 
the  denominator  tends  to  some  strictly  positive  number.  Consequently,  Q(u)  — >0  and  is 


■HP  | 
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poorer  than  the  feasible  solution  u — 1/2,  which  yields  a strictly  positive  Q(u).  Consequently, 
0 < w*  < 1. 


(B)  For  the  optimal  solution,  observe  that  from  (62)  and  (63)  we  have 

Lim  Ek~jEk  — * 1,  so  that 

k—oo 


Lim  Q(u)  — pw  (1  - u). 

k—oo 

* By  setting  the  derivative  of  pu  (1  — u)  to  zero,  we  find  that  u*  — 1/2  uniquely  maximizes 

Q(u)  and  that  (?(«*)  - p/4. 


(C)  From  Theorem  5 and  Theorem  7 (A),  for  any  k , the  optimal  objective  function  value  for 
P}  is  less  than  or  equal  to  p/4.  With  u‘  - u*  «■  1/2  for  all  /€A",  the  objective  function  for 
Problem  P4  attains  the  value  p/4  as  /c  — Since  P4  is  a more  constrained  problem  than  P3, 
it  follows  that  the  solution  u’  = 1/2,  for  »'€ K\  is  also  optimal  to  P3. 

Thus,  from  Theorem  9 we  find  that  if  k — 1 ’ °°  an  optimal  state-dependent  pricing  policy 
is,  in  fact,  state-independent.  To  get  a feel  for  the  closeness  of  the  two  policies  for  any  finite  k, 
the  same  48  problems  solved  in  Section  4.4  were  resolved  by  the  problem  formulation  Pk.  In 
all  the  48  problems  the  function  Q(u)  was  found  to  be  unimodal.  Using  the  (conjectured)  uni- 
modality property,  the  optimal  u*  for  the  48  problems  were  determined  by  Fibonacci  search 
[20,  pp.  24-30]  in  a total  of  18.7  s (approximately  0.4  s/problem).  It  was  found  that,  although 
the  state-independent  pricing  policy  was  obviously  poorer  than  the  state-dependent  policy  in 
terms  of  the  objective,  the  difference  in  the  values  of  the  objective  function  between  the  two 
policies  was  very  small,  ranging  from  0 to  1.5%,  with  an  average  of  0.7%  over  the  entire  set  of 
problems  tested.  For  the  case  when  p/k  — 1 (a  likely  situation  with  X — kr\),  the  percent 
difference  drops  from  0.312%,  for  k — 2,  to  0.00067%  for  k — 40.  As  explained  in  Section  1, 
this  may  account,  at  least  partly,  for  the  absence  of  state-dependent  pricing  in  many  large  rental 
systems.  For  a given  k,  the  percent  difference  is  the  largest  for  p/k  — 3.  It  drops  sharply  as 
p/k  decreases  below  3,  but  drops  only  gradually  as  p/k  increases  above  3. 

6.  SOME  GENERALIZATIONS  OF  THE  PROBLEM  FORMULATION  PI 

The  rental  policy  considered  in  Section  1 was  a rental  rate  of  the  form  v,  dollars/h.  Let 
us  assume  that  the  policy,  in  addition,  involves  a fixed  charge  of  the  form  A,  dollars/rental,  so 
that  the  expected  total  rental  cost  per  rental  is  A,  + (v,/rj).  Now,  if  we  assume  that  a 
customer’s  probability  of  renting  decreases  linearly  with  the  expected  total  rental  costs,  i.e., 

* (64)  />,(/!„  v,)  = 1 - b [A,  + (v,/tj)], 

and  follow  a line  of  reasoning  similar  to  that  in  Section  1,  Problem  Ps  becomes: 

Maximize  D( A,  v)  - £ XM,  + (v,/tj)]  {1  - b[A{  + (v,/t))]}7r, 

K'  i€/r 


i 
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subject  to 


7T)+1  - X { 1 - b[A,  + (v(/tj)] J-7T ,/[(/  + Dtj],  for  /€K', 

- 1. 

1 € K 

ir,  ^ 0,  for  /€X, 


and 

0 < A,  + (vjy)  ^ Mb,  for  /€ AT'. 


Fortunately,  Problem  P5  can  be  reduced  to  the  mathematical  form  P\  (equations  (15) 
through  (19))  if  we  use  the  transformation 

u,  = b [A,  + (v, /•»))],  for  /€X' 

and  maximize  (b/i))D  instead  of  D.  (Since  b/t)  is  a strictly  positive  constant,  the  optimal  u’ 
will  not  be  affected  by  this  change  in  the  objective  function.)  The  equivalence  of  the  two  prob- 
lem formulations  shows  that  the  optimal  A'  and  v,*  can  be  set  arbitrarily,  subject  to 
b[A,‘  + (v,7t?)]  - u‘. 

Another  worthwhile  extension  is  to  assume  that  the  service  time  depends  on  the  rate  v,  *t 
which  the  unit  was  rented,  e.g.,  the  parameter  rj  may  be  modelled  as 

i)i  — c + rfv,  (c  > 0,  d > 0), 

so  that  if  the  rental  rate  is  high,  the  unit’s  expected  rental  time,  I/17,,  will  be  smaller.  The 
objective  D(v)  (equation  (9))  can  be  easily  modified  to  take  this  change  into  account.  How- 
ever, the  dependence  of  service  times  on  the  rental  rate  destroys  the  underlying  Markovian 
character  of  the  original  model  P0  in  terms  of  the  transition  equations  (10).  Now,  when  the 
process  is  in  state  i,  some  previous  history  of  the  system  is  also  needed.  For  instance,  when 
k — 2 and  i = 2,  it  must  be  known  whether  both  units  were  rented  at  U\  or  one  at  u0  and  the 
other  at  ut.  Correspondingly,  the  step  down  transition  rate  will  be  2rji  or  (t)0  + t),).  One 
method  of  overcoming  this  difficulty  is  to  augment  the  state-space  and  reindex  the  states,  so 
that  the  process  will  assume  the  underlying  Markovian  character  (5,  p.181.  This,  however, 
increases  the  state  space  from  ( k + 1)  to  ( k + 1)  (2k  + l)/6  and  destroys  the  structure  of  the 
constraint  matrix  (10)  through  (13),  which  permitted  the  efficient  solution  procedure  of 
Section  4. 

Clearly,  other  extensions,  such  as  a general  nonlinear  form  for  the  probability  of  renting 
/>(v,)  and  general  arrival  and  service  time  distributions,  would  be  useful.  However,  these 
extensions  can  be  made  only  at  the  expense  of  greatly  increased  computational  effort. 
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APPENDIX 


In  this  appendix,  we  use  a discrete  optimal  control  approach  [3,4]  to  obtain  the  necessary 
conditions  for  the  optimal  solution  to  P\.  The  resulting  conditions  will  be  shown  to  be 
equivalent  to  (38)  through  (41),  (30),  and  (34)  of  the  nonlinear  programming  approach  dis- 
cussed in  Section  4. 

* 

If  we  define  s,  - £ n j (cf.  the  dynamic-programming  procedure  in  Section  3),  Problem 
Px  ((15)  through  (19))  can  be  rewritten  as  Problem  PAl, 

(Aj)  Maximize  F(u)  - £ p«,  (1  - «,)  ir, 

• ■ » € AT' 


subject  to 

• 

(A2) 

ir(+,  — ir,  - ir,  ([p/(/  + 1)]  (1  - «,)  - 1),  for  /€Af' 

(A3) 

s,+1  ~ Si  * - rr„  for  / 6A’, 

(A4) 

s0”  1. 

(A5) 

0 < sk-nk, 

(A6)  0 < «,  < 1,  for /€*'. 

and 

(A7)  0 < it,  <s,  < 1,  for  /6A. 


> 

* 


Problem  PAl  is  in  the  form  of  a discrete  optimal  control  problem,  with  u as  the  control 
variable  and  ( if , s)  as  the  state  variables.  We  first  show  that  the  constraints  (A7)  are  redun- 
dant. 


THEOREM  Al:  For  Problem  PA]  (Al)  through  (A7),  constraints  (A7)  are  redundant. 
PROOF:  From  (A5),  irk  > 0. 

From  (A2),  rr,  - (/  + l)rr,+1/p(l  - «,). 

From  (A6),  (1  - «,)  > 0,  so  that  by  backward  recursion,  ir,  > 0 for  /€A. 

Equation  (A3)  may  be  rewritten  as 


S,  - S,+ 1 + 7T,. 
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Since  sk  > 0 and  7r*_,  ^ 0,  it  follows  that  s*_,  > w*_i  > 0 and  s*-i  ^ s*.  By  backward 
recursion,  s,  > w,  > 0 and  s,  > s,+1,  for  /€  A'.  Consequently,  from  (A4),  1 - s0  > s„  for 
i € A,  thus  completing  the  proof. 

For  a given  state  vector  (w,  s),  the  constraints  (A2),  (A3),  and  (A6)  are  linear  in  u,  and 
the  / th  term  in  (Al),  p«,(  1 — u,)ir„  is  a negative  definite  quadratic  form  in  u,.  Thus,  the 
directional  convexity  and  other  requirements  [4,  pp.  86-87]  are  satisfied,  and  hence  the  neces- 
sary conditions  for  discrete  optimal  control  [4,  pp.  91-92]  apply. 

Let  tv,}  and  {ij,  for  / € AT",  be  the  acljoint  variables  associated  with  (A2)  and  (A3) 
respectively.  Then  the  Hamiltonian  of  the  problem  is  given  by 

(A8)  //(ir„  s„  Ui,  y,+1,  e/+1,  /)  - 

p«,(l  - «,)ir,  + {[p/(/  + 1)]  (1  — «,)  — 1}  w,y/+,  - 7r,e,+1. 


The  adjoint  equations  are  given  by 

(A9)  y,  - y,+I  - pu,(l  - u)  + {[p/0  + 1)]  (1  - «,)  - l}y,+1  - em,  for  / € AT', 
and 

(A10)  e,  — ei+i  — 0,  for  /€Af'. 

The  transversality  conditions  corresponding  to  (A4)  and  (A5)  are 

(All)  y0  ” 0 

and 

(A12)  yk  - - ek. 

From  (A10)  and  (A12)  we  get 

(A13)  e,  - - yk  - E (say),  for  i€K. 

By  the  discrete-maximum  principle,  if  {«,*}  is  optimal  then,  for  each  /€  A"  and  for  all  u,  satisfy- 
ing (A6), 

(A14)  H(n‘,  s’,  u',  y,‘+l,  e’+h  i)  ^ H(ir’,  s',  u„  y’+i,  e’+h  i), 


V 


* 


where  it',  s’,  y,*+I,  and  e,*+1  are  derived  from  (A2)  through  (AS)  and  (A9)  through  (A  12)  with 
u' substituted  for 
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t 


By  (A  14)  and  from  (53)  (i.e.,  1/2  <u'<  1),  u,’  can  be  obtained  by  differentiation  of 
H(w',  s'.  u„  y,'+ e/+1. ) (equation  (A8)).  This  yields 


I 


T 


(A15)  «/-{l  - fo+1/(/+l>])/2. 

Substituting  (A15)  and  (A13)  for  u,  and  e/+|  in  (A9)  and  simplifying  the  resulting  expression, 
we  obtain 

(A16)  y,'  - (p/4)  ly/+1  /(/+1))2  + (p/2)  ly/+1  /(/+1)J  + (p/4)  - E. 

Defining 

(A17>  x,  - y'/i,  or  y' - ix„ 

we  can  simplify  (A16)  to 

(A18)  ix,  — (p/4)  (l+x/+i)2  - £,  for  / € AT', 

or 

(A19)  a;  - (p/4/)  (1  + a(+,)2  - (E/i),  for  / - 1.2 k - 1. 

(The  condition  for  / — 0 is  considered  later  in  (A21)). 

The  transversality  condition  (A12)  together  with  (A13)  and  (A17),  yields 

(A20)  xk  - - E/k. 

The  transversality  condition  (All),  together  with  (A17)  and  (A18),  yields 
(A21)  (p/4)  (1  + x,)2  - E - 0. 

Furthermore,  (A15)  and  (A17)  yield 

(A22)  «>  (1  - x,+I)/2,  for  /€*', 

so  that  the  conditions  (A6)  can  be  rewritten  as 

(A23)  x,  < 1,  for  / CAT". 


J 


and 
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(A24)  x,  > - 1,  for  /€*". 

We  can  summarize  the  above  results  as  follows: 


) 

} 

I 

) 


THEOREM  A2:  Suppose  that  u*  is  optimal  to  P,.  Then  there  exists  an  £ such  that 
(A  19)  through  (A24)  are  satisfied. 

We  now  show  that  the  necessary  conditions  for  P,,  as  stated  by  Theorem  A2,  are  pre- 
cisely the  same  as  the  conditions  derived  for  the  nonlinear-programming  approach  to  the  prob- 
lem detailed  in  Section  4. 

THEOREM  A3:  The  system  (A19)  through  (A24)  is  equivalent  to  the  conditions  (38) 
through  (41),  (30),  and  (34)  under  the  transformations 

(A25)  x,  — (2«,/p)  - 1 

and 

(A26)  £ - «. 

PROOF:  By  direct  substitution  of  (A25)  and  (A26),  it  can  be  verified  that  the  conditions 
(A19)  through  (A24)  are  the  same  as  (39),  (40),  (38),  (30),  (34),  and  (41)  respectively. 

Thus,  the  discrete  optimal-control  approach  leads  to  the  same  conditions,  and  hence  the 
same  solution  procedure,  as  Algorithm  1 described  in  Section  4. 


} 

1 

! 
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ON  THE  FIRST  TIME  A SEPARATELY  MAINTAINED  PARALLEL 
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ABSTRACT 

Consider  a system  consisting  of  n separately  maintained  independent  com- 
ponents where  the  components  alternate  between  intervals  in  which  they  are 
"up"  and  in  which  they  are  "down”.  When  the  ("'component  goes  up  (down) 
then,  independent  of  the  past,  it  remains  up  (down]  for  a random  length  of 
time,  having  distribution  F \G),  and  then  goes  down  tup).  We  say  that  com- 
ponent t is  failed  at  time  t if  it  has  been  ’down"  at  all  time  points  s€[r-,4.rl; 
otherwise  it  is  said  to  be  working.  Thus,  a component  is  failed  if  it  is  down  and 
has  been  down  for  the  previous  A time  units.  Assuming  that  all  components 
initially  start  "up,"  let  T denote  the  first  lime  they  are  all  failed,  at  which  point 
we  say  the  system  is  failed.  We  obtain  the  moment-generating  function  of  T 
when  n — 1,  for  general  F and  G,  thus  generalizing  previous  results  which  as- 
sumed that  at  least  one  of  these  distributions  be  exponential.  In  addition,  we 
present  a condition  under  which  T is  an  NBU  (new  better  than  used)  random 
variable.  Finally  we  assume  that  all  the  up  and  down  distributions  F , and 

Gj  i— 1 n,  are  exponential,  and  we  obtain  an  exact  expression  for  £(  T)  for 

general  n:  in  addition  we  obtain  bounds  for  all  higher  moments  of  T by  show- 
ing that  T is  NBU. 


INTRODUCTION  AND  SUMMARY 

In  considerating  a system  that  works  for  a random  time  and  when  failed  is  fixed  in  a 
length  of  time  that  is  also  random,  an  important  variable  is  the  first  time  the  system  is  not 
working  for  an  interval  of  time  longer  than  some  prespecified  value.  For  instance,  in  a nuclear 
reactor,  when  the  safety  system  is  out  for  some  critical  time,  it  is  necessary  to  shut  down  the 
complete  system,  with  all  the  problems  this  entails.  In  the  food  industry,  where  food  must  in 
general  be  kept  at  a certain  temperature,  an  important  question  that  arises  when  the  refrigera- 
tion system  goes  down  is  how  long  this  situation  can  be  maintained  before  the  food  becomes 
spoiled. 


"This  research  has  been  partially  supported  by  the  Air  Force  Office  of  Scientific  Research  (AFSC),  USAF,  under  Grant 
AFOSR-77-3213  and  the  Office  of  Naval  Research  under  Contract  N00014-77-C-0299  with  the  University  of  California. 
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In  this  paper,  we  consider  a system  consisting  of  n separately  maintained  independent 
components,  where  the  components  alternate  between  intervals  in  which  they  are  "up"  and  in 
which  they  are  "down."  When  the  /'*  component  goes  up  [down]  then,  independent  of  the  past, 
it  remains  up  [down]  for  a random  length  of  time,  having  distribution  /r,[G,),  and  then  goes 
down  [up].  We  say  that  component  i is  failed  at  time  t if  it  has  been  "down"  at  all  time  points 
s € [/ — A,t\\  otherwise,  it  is  said  to  be  working  at  time  r.  Thus,  a component  is  failed  if  it  is 
down  and  has  been  down  for  at  least  previous  A time  units.  Assuming  that  all  components  ini- 
tially start  "up,"  let  T denote  the  first  time  they  are  all  failed,  at  which  point  we  say  the  system 
is  failed. 

In  Section  1,  we  obtain  the  moment-generating  function  of  T when  n “ 1,  for  general  F 
and  G,  thus  generalizing  results  in  [5]  and  [6]  which  assumed  that  at  least  one  of  these  distribu- 
tions be  exponential.  In  Section  2,  we  present  a condition  under  which  T is  an  NBU  (new 
better  than  used)  random  variable.  In  Section  3,  we  assume  that  all  the  up  and  down  distribu- 
tions F,  and  <?■,/— 1,  are  exponential,  and  we  obtain  an  exact  expression  for  E(.T)  for 
general  n\  in  addition,  we  obtain  bounds  for  all  higher  moments  of  T by  showing  that  T is 
NBU. 

1.  THE  CASE  n * 1 

Let  us  denote  by  N the  number  of  "up"  intervals  that  occur  before  the  component  fails. 
Then,  given  /V  — k,  we  can  represent  T by 

(1)  T-  Xi  + ...  + Xk  + Y{  + ...  + J?_,  + A. 

where  X,  denotes  the  length  of  the  i'h  up  cycle  and  Yf  the  length  of  the  i'h  down  cycle  before 
failure.  All  the  random  variables  in  the  representation  (1)  are  independent,  with  the  X,  having 
distribution  £and  the  Yf  having  distribution 


P[Yf<  x)  - P[Y  < x\Y  < A) 


G Or) 


G(A)  ’ 
1. 


0 < x<A, 
x > A, 


where  F is  the  distribution  of  an  up  cycle  and  G that  of  a down  cycle,  and  Y is  a generic  vari- 
able, having  distribution  G,  and  representing  the  unconditional  length  of  a down  cycle.  As 

P(S  = *]  « G(/0[G(/0]*-U  - 1 

1 - G , we  obtain  the  moment-generating  function  of  T by  conditioning  on  /V  as 


where  G 
follows: 


Ele’r]  - E[£[ejr|  N]] 


i 


(2) 


iA<t>x(s)G(A)  X [<Ms)<M*)G(/l)j 


e^+xMGiA) 

1 - G(/1)<Ms)<Ms)  ’ 


r 


. 


! 

i 


! 


i 
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and 


d>x(s) 


EleiX)  - f °*  eadF(x) 

JQ 

, AM  - C^dG(x) 
l 1 Jo  G(A)  • 
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For  the  special  case  in  which  X is  exponential  with  mean  1/A  and  Y is  exponential  with 
mean  \/n  , we  have 


EWT]  - 


s2  — (A  + n)s  + kne  s)a 
a result  previously  obtained  in  [S]  and  [6], 


All  of  the  moments  can  now  be  obtained  by  successive  differentiation  of  (2)  or  by  a direct 
conditioning  argument.  For  instance,  we  obtain 

E[T]  - £l£[r|Am 

- £[N£M  + (N  - 1) £( F|  Y </<]  + /*] 

(3)  _ £tf L + A 

~ G(A)  G(A) 


By  viewing  the  working-failed  system  as  an  alternating  renewal  process,  we  deduce  that 
the  long-run  proportion  of  time  the  component  is  failed  is 

E[Y  - A\Y  > A]  L G(y)dy 

E[T)  + E[Y  - A\Y  > A)  “ £[F]  + £U1  ‘ 

2,  WHEN  IS  T NBU,  n = 1 

The  nonnegative  random  variable  IF  is  said  to  be  new  better  than  used  (written  NBU)  if 

P{W  > s + t\W  > s}  s£  P{W  > /},Vs,f  > 0. 

If  we  think  of  W as  representing  the  life  of  some  object,  then  W NBU  means  that  the  addi- 
tional remaining  life  of  any  s-year-old  (i.e.,  used)  item  is  stochastically  smaller  than  that  of  a 
new  item,  for  all  s . 

If  W is  NBU  and  has  distribution  function  H,  then  we  also  say  that  H is  NBU. 

PROPOSITION  1:  If  X,  the  length  of  an  up  time,  is  NBU,  then  so  is  T. 

PROOF:  Suppose  failure  has  not  yet  occurred  by  time  s.  Now  there  are  two  possibilities: 

CASE  1:  At  time  s the  component  is  up  and  has  been  up  for  a time  t.  In  this  case  the 
remaining  time  to  failure  has  the  distribution  of  the  convolution  of  F,  and  //,  where  F,  is  the 
distribution  of  remaining  up  time  for  a component  that  has  been  up  for  a time  t and  H is  the 
distribution  of  time  to  failure  starting  with  the  component  initially  down.  But  since  F,  is  sto- 
chastically smaller  than  F (the  definition  of  X being  NBU),  this  distribution  is  stochastically 
smaller  than  the  convolution  of  £and  //,  which  is  the  distribution  of  T. 
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CASE  2:  At  time  s the  component  is  down  and  has  been  down  for  a time  / (necessarily, 
i < A)  . In  this  case  the  remaining  time  to  failure  has  some  distribution,  call  it  D.  However, 
the  distribution  of  T can  be  written  as  the  convolution  of  D and  the  distribution  of  the  first 
time  that  the  component  has  been  down  for  t consecutive  time  units.  This  latter  convolution 
distribution  is  clearly  stochastically  larger  than  D. 

Thus,  in  all  cases  the  distribution  of  T is  stochastically  larger  than  the  distribution  of 
remaining  time  until  failure.  Hence  Tis  NBU.|| 

3.  EXPONENTIAL  LIFETIMES,  GENERAL  n 

In  this  section  we  suppose  there  are  n components  and  the  distribution  of  up  [down]  time 

for  the  i'h  component  is  exponential,  with  rate  Xj/ij,  / - 1 n.  We  start  by  deriving 

£171,  the  expected  time  until  the  system  fails;  that  is,  until  all  components  are  failed,  starting 
with  all  components  up. 

We  can  write  T as  the  sum  of  independent  random  variables  as  follows: 

<«>  T-T^+Z, 

where  TA.Q  denotes  the  first  time  that  all  components  are  down  (it  is  thus  equal  to  Tin  the 
special  case  A « 0 ) and  Z the  extra  (or  additional)  time  from  Ta~q  until  all  components  are 
failed.  Now  Brown  ll]  has  computed  E[TA.^  and  shown  that 


£ir,_ol  - I I 

A-l  'l  <,2<  • ■ 


k LL. 

n 


,/-i 


L +M() 

j-l 


Thus,  it  remains  to  compute  E[Z],  Let  M denote  an  exponential  random  variable  with  rate 

n 

M = • Then,  by  conditioning  on  whether  or  not  all  components  remain  down  in  the  A 

i 

time  units  following  time  TA.0  , we  obtain 

ElZ]  - Ae + (1  - e~>l',)lElMlM<Al  + E[D)  + E\Z) ], 

where  D is  the  time  until  all  components  are  down,  given  that  they  were  all  down  and  one  has 
just  gone  up.  Thus,  from  the  above,  we  obtain 


(5) 


ElZ ] - A + ( e 1) 


f0  fixe  ~ »xdx 


1 — e 


HA 


+ E[D] 


However,  Ross  [3]  has  shown  that 

(6)  i - n — Kj— 

7-t  +x; 


E[D)  - 


i-i  /-i  + kj 


and  thus  the  expression  for  E[T]  follows  from  (4),  (5)  and  (6). 
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The  next  proposition  partly  characterizes  the  distribution  of  T and  will  enable  us  to  obtain 
bounds  on  all  higher  moments  of  T. 

PROPOSITION  2:  T is  NBU. 

PROOF:  Suppose  that  all  components  have  never  been  simultaneously  failed  by  time  s. 
There  are  two  cases: 

CASE  1:  At  time  s all  components  are  down,  the  one  that  has  been  down  for  the  shortest 
time  having  been  down  for  a time  t (where,  necessarily,  t < A).  Since  T can  be  expressed  as 
TAm,  (the  first  time  all  components  have  been  down  for  the  past  t time  units)  plus  a random 
variable  having  the  same  distribution  as  the  remaining  time  to  failure  of  the  system,  it  follows 
that  T is  stochastically  larger  than  the  remaining  time  to  system  failure  in  this  case. 

CASE  2:  Not  all  components  are  down  at  time  s.  In  this  case  the  remaining  time  to  sys- 
tem failure  can  be  written  as  the  time  until  all  components  are  down  plus  an  independent  ran- 
dom variable  having  the  same  distribution  as  Z in  the  representation  (4).  Now  Ross  [4]  has 
shown  that  the  time  until  all  components  are  down  is  stochastically  larger  when  it  starts  with  all 
being  initially  up  than  when  it  starts  in  any  other  position.  Hence,  from  the  representation  (4), 
it  follows  that  the  remaining  time  to  system  failure  at  time  s is  stochastically  smaller  than  T. 

Hence,  in  all  cases  T is  stochastically  larger  than  the  remaining  time  to  system  failure, 
thus  proving  the  result.|| 

The  above  result  is  particularly  useful,  as  it  enables  us  to  obtain  bounds  on  E[f(T)], 
whenever  / is  an  increasing  convex  function,  by  use  of  the  following  special  case  of  Theorem 
4.6  of  Marshall  and  Proschan  [2]. 

PROPOSITION  3:  If  X is  NBU  with  mean  1/A  , then 

E[f(X)]  < J*0°°  /(x)Ae  ~Kxdx 
for  all  increasing  convex  functions  /. 

In  words,  Proposition  3 says  that  if  X is  NBU,  then  E[f(X)]  < £[/(Af)]  for  all  increas- 
ing convex  /,  where  M is  an  exponential  random  variable  having  the  same  mean  as  X. 

COROLLARY  1:  Var(T)  < (£Tfl)2. 

PROOF:  Follows  immediately  from  Propositions  2 and  3 by  use  of  the  function 

/(x)  - x2 . 
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ABSTRACT 

This  paper  describes  a deterministic  capacity-expansion  model  for  two  facil- 
ity types  with  a finite  number  of  discrete  lime  periods.  Capacity  expansions  are 
initiated  either  by  new  construction  or  by  the  conversion  of  idle  capacity  from 
one  facility  type  to  the  other.  Once  converted,  the  capacity  becomes  an  integral 
part  of  the  new  facility  type.  The  costs  incurred  include  construction,  conver- 
sion, and  holding  costs.  All  cost  functions  are  assumed  to  be  nondecreasing 
and  concave.  Using  a network  flow  approach,  the  paper  develops  an  efficient 
dynamic-programming  algorithm  to  minimize  the  total  costs  when  the  demands 
for  additional  capacity  are  nonnegalive  in  each  period.  Thereafter,  the  algo- 
rithm is  extended  for  arbitrary  demands.  The  model  is  applied  to  a cable-sizing 
problem  that  occurs  in  communic  ition  networks,  and  numerical  examples  are 
discussed. 


INTRODUCTION 


Capacity-expansion  models  are  needed  to  plan  the  expansion  of  facilities  over  time  so  as 
to  satisfy  given  demands  at  the  lowest  possible  cost.  In  this  paper  we  describe  a deterministic 
model  for  two  facility  types.  The  model  assumes  a finite  number  of  discrete  time  periods,  with 
known  demands  for  each  of  the  two  facilities  in  each  period.  These  demands  must  be  satisfied 
immediately;  i.e.,  shortages  of  capacity  are  not  allowed.  In  each  period,  facility  /(/  = 1,2)  may 
be  expanded,  either  by  new  construction,  or  by  conversion  of  idle  capacity  associated  with  facil- 
ity j(J  = 1.2  and  j ^ i)  to  accommodate  the  demand  for  facility  /.  Conversion  implies  physi- 
cal modification,  so  that  the  converted  capacity  becomes  an  integral  part  of  the  new  facility  and 
is  not  reconverted  automatically  at  the  end  of  the  period.  The  costs  incurred  include  construc- 
tion and  conversion  costs,  and  holding  costs  of  idle  capacity.  All  cost  functions  depend  on  the 
time  period  and  are  assumed  to  be  nondecreasing  and  concave,  perhaps  reflecting  fixed  charges 
and  economies  of  scale.  It  is  assumed  that  the  operating  costs  depend  only  on  the  quantity  of 
active  capacity;  hence,  they  are  independent  of  the  expansion  policy  and  are  omitted  from  the 
model.  The  capacity-expansion  policy  consists  of  timing  and  sizing  decisions  for  new  construc- 
tion and  conversion,  and  the  objective  is  to  find  the  policy  which  minimizes  total  costs. 


The  study  has  been  stimulated  by  communication-network  applications,  especially  a 
cable-sizing  problem.  Concentrating  on  a single  link  of  a communication  network,  we  assume 
that  there  are  demands  for  two  types  of  cables.  Each  cable  type  is  characterized  by  the  diameter 
of  the  wire  pairs  in  that  cable,  and  the  cable  size  is  simply  the  number  of  wire  pairs  included  in 
the  cable.  The  cable  type  needed  to  serve  the  demand  for  the  link  associated  with  any  two  end- 
points of  the  network  depends  on  the  distance  between  those  endpoints.  Furthermore,  the 
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more  expensive  cable  type  (the  one  which  consists  of  the  larger  wire  pairs)  can  serve  both 
demands,  whereas  the  cheaper  cable  can  serve  only  its  associated  demand.  Since  the  construc- 
tion cost  is  a concave  function  of  the  cable  size,  it  may  be  attractive  to  use  only  the  expensive 
cable  to  satisfy  the  demands  for  both  cables.  Another  similar  application  of  the  model  for  com- 
munication networks  is  the  planning  of  capacity  expansion  associated  with  facilities  which  serve 
both  digital  and  analog  demands. 

The  model  may  also  be  useful  for  certain  transportation  problems.  For  example,  it  can  be 
used  to  plan  the  capacity-expansion  policy  for  two  modes  of  transportation,  such  as  passenger 
and  freight  trains,  where  passenger  trains  can  be  converted  to  handle  the  shipment  of  goods.  In 
addition,  the  model  can  also  be  viewed  as  a production  problem  for  two  substitutable  products 
or  as  an  inventory  problem  for  a single  product  produced  and  consumed  in  two  separate 
regions.  In  the  latter  case,,  the  demand  for  additional  capacity  in  each  period  is  defined  as  the 
demand  for  the  product  in  each  of  the  two  regions.  Furthermore,  idle  capacity  is  replaced  by 
inventory,  capacity  construction  is  replaced  by  production,  and  capacity  conversion  is  replaced 
by  shipment  of  the  product  from  one  region  to  the  other. 

Many  capacity-expansion  and  inventory  models  have  been  developed  for  the  single  facility 
problem  with  a finite  number  of  discrete  time  periods.  The  first  such  model  with  time- 
dependent  costs  was  proposed  by  Wagner  and  Whitin  [13],  who  examined  a dynamic  version  of 
the  economic  lot-size  model.  Many  authors  extended  this  model;  for  example,  Zangwill 
[15,161,  Manne  and  Veinott  [10],  Florian  and  Klein  [4],  and  Rao  [12]. 

Several  models  for  two  facilities,  in  which  it  was  assumed  that  converted  capacity  is  recon- 
verted automatically,  at  no  cost,  at  the  end  of  each  period,  have  been  published.  Appropriate 
references  are  Manne  [9],  Erlenkotter  [2,31,  Kalotay  [7]  and  Fong  and  Rao  [51.  In  many  appli- 
cations (such  as  those  mentioned  before),  it  is  more  reasonable  to  assume  that  converted  capa- 
city is  not  reconverted  at  the  end  of  each  period.  Kalotay  [8]  and  Wilson  and  Kalotay  [14] 
extended  Kalotay ’s  earlier  work,  and  Merhaut  [111  extended  Erlenkotter’s  work  [2]  for  this 
case.  The  model  described  in  this  paper  is  similar  to  [5]  for  the  case  when  converted  capacity  is 
not  reconverted  at  the  end  of  each  period. 

In  Section  1 we  formulate  the  model,  and  in  Section  2 a dynamic-programming  approach 
is  presented.  In  Section  3 some  properties  of  an  optimal  solution  are  identified  through  a 
network-flow  representation,  and  a computational  procedure  for  nonnegative  demand  incre- 
ments is  developed.  In  Section  4 the  procedure  is  modified  for  arbitrary  demands.  Finally,  in 
Section  5 the  model  is  applied  to  a cable-sizing  problem. 


1.  FORMULATION 
Let 


ij  — indices  for  the  two  facilities. 

/ - an  index  for  time  period  (/  - 1,2,  ....  T + 1,  where  T is  the  planning  hor- 
izon). 

r„  — The  increment  of  demand  for  additional  capacity  of  facility  / at  period  t.  For 
the  present  we  assume  that  r„  > 0;  however,  this  assumption  is  relaxed  in  Sec- 
tion 4.  Also,  for  convenience,  the  r,,'s  are  assumed  to  be  integers. 
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'l 

R,Ui.t2)  - L rn>  for  'i  < '2- 

'“'i 

R,  - R|(f,n  + R2(r,T). 

x„  - The  amount  of  new  construction  of  facility  / at  perio  ’ t. 

y,i  - the  amount  of  capacity  associated  with  facility  i converted  at  period  t to  satisfy 
demand  for  facility  j.  Once  converted,  the  capacity  becomes  an  integral  part  of 
facility  j. 


/„  - The  amount  of  idle  capacity  of  facility  / at  the  beginning  of  period  t (or, 
equivalently,  the  idle  capacity  at  the  end  of  period  r — 1,  f-2,  3,  ....  T + 
1).  We  assume  that  the  initial  idle  capacities  are  zero,  /,,  — 0,  and  that  shor- 
tages of  capacity  are  not  allowed;  i.e.,  /„  ^ 0. 

c„(j £■„)  - the  construction  cost  of  x„. 

g„(y„)  “ the  conversion  cost  of  y„. 

1)  “ the  holding  cost  of  idle  capacity  /,,+)  from  period  Mo  period  t + 1. 

All  cost  functions  c„  (•),  «,(•),  and  //,,(•)  are  assumed  to  be  nondecreasing  and  concave. 
The  problem  can  be  stated  as  follows: 

r 2 

(1-D  Minimize  £ £ lc„(x,7)  + g„(y„)  + /?„(/, -,+1)l 

xir  yH  /-I  / — | 


(1.2)  A.r+i  - K + x»  + y a - y n - r„. 

(1.3)  x„  ^ 0,  y„  > 0,  /„  > 0, 

(1)  (1.4)  In  =0, 

(1.5)  /,.  r+i= 

where,  for  convenience,  we  assume  that  c„  (0)  - git( 0)  - /t„(0)  - 0.  The  objective  (1.1)  is  to 
minimize  the  total  costs  incurred,  specifically  the  construction,  conversion,  and  holding  costs 
over  all  periods.  The  constraints  (1.2)  state  that  the  idle  capacity  of  facility  / at  the  beginning 
of  period  / + 1 is  equal  to  the  idle  capacity  at  the  beginning  of  period  t plus  the  net  change  of 
the  capacity  of  facility  i at  period  f minus  the  demand  increment  for  facility  i at  /.  The  con- 
straints /„  > 0 and  1 1 “ 0 are  introduced  by  the  assumptions.  Furthermore,  the  idle  capacities 
at  the  end  of  period  T,  i.e.,  li  T+  (,  are  fixed  at  zero,  since  for  r,,  > 0 any  other  solution  can 
readily  be  modified  to  satisfy  this  constraint  without  increasing  the  total  costs. 


/ - 1,2, 

j - 1,2  0 * '), 
t - 1,2 T. 


294 


H.  LUSS 


2.  A DYNAMIC-PROGRAMMING  APPROACH 

The  constraints  (1.2)  through  (1.5)  form  a nonempty  convex  set  (*„  - r„,  - /„  - 0, 

V/  and  /,  is  a feasible  solution).  Since  each  component  of  the  objective  function  (1.1)  is  nonde- 
creasing with  a finite  value  at  zero  and  all  variables  are  required  to  be  nonnegative,  there  exists 
a finite  optimal  solution  to  problem  (1).  Furthermore,  since  (1.1)  is  concave,  there  exists  an 
extreme  point  solution  which  minimizes  (1.1);  we  shall  concentrate  on  finding  such  a solution. 

We  define  a capacity  point  as  a period  t for  which  /|,/2,  — 0.  The  constraints  (1.2)  can  be 
shown  to  be  totally  unimodular  (Hu  [6]).  Hence,  since  the  r„'s  are  integers,  any  extreme-point 
solution  consists  of  integer  values  for  all  variables,  and  only  the  following  idle-capacity  values 
of  capacity  points  need  be  considered: 


' i.r+i  '2.t+\ 


h\  “ 
h,  - 0. 

0 ~and  / 2/  =*1,2, 
0 and  /|,  — 1,2, 

/ ■>  r+i  “ 0. 


R„  < - 2,3 T, 

R,. 


Since  at  most  one  idle-capacity  value  is  positive  at  a capacity  point,  we  conveniently  define  the 
values  in  (2)  by  a single  parameter  a,: 

Of  - 1 if  fu  “ ht  “ 0. 

(3)  a,  = m + 1 if  /1(  - 0 and  /2,  - m (m  - 1,2 R,), 

a,  - m + R,  + 1 if  /2(  - 0 and  1\,  - m (m  - 1,2,  ...  , R,). 

Thus,  a,  may  take  on  any  of  the  values  1,2,  ....  2 R,  + 1. 

We  now  describe  a dynamic-programming  approach  that  can  be  used  to  solve  problem  (1). 


duv(au,av+i)  =»  the  minimal  cost  associated  with  an  optimal  policy  during  periods 
u,  u + 1 , . . . , v,  when  u and  v + 1 are  two  successive  capacity  points 
with  idle-capacity  values  defined  by  au  and  av+).  More  specifically: 


(4)  I v 2 

</„„(<*,„  av+l)  - minimum  £ £ [c(f0r,()  + g„(y,)  + h„Uu+ ,)) 


where 


Xtl  ,Vtl  If  — II 


(i)  The  constraints  (1.2)  and  (1.3)  are  satisfied  for  t - u,  u + 1 v, 

(ii)  / 1,/2,  >0,  t = u + 1,  « + 2,  . . . , v, 

(iii)  / 1„  and  l2„  are  given  by  a„,  and  /|.v+i  and  /2  v+i  are  given  by  av+I. 


r 
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Furthermore,  let 

/,(«*,)  - the  cost  of  an  optimal  policy  over  periods  t,  t + 1,  . . . , T,  given  that  period  f 
is  a capacity  point  and  /t,  and  /2,  are  specified  by  a,. 

Assume  that  all  the  subproblem  values  duv(au,  av+!)  are  known.  The  following  dynamic- 
programming formulation  is  then  obtained: 

/r+i(“r+i)  “0,  «r+i  “ 1< 


fu  (®i/)  " min  [dtlv  (otu , 1 ) -I-  fv+ j (otv+ | ) 1 , 

«<»<  r 

u - T,  T - 1 1, 

«„  - 1,2 2 Ru  + 1 ( u * 1). 

a,  - 1. 


The  first  term  of  the  minimand  is  the  minimum  cost  of  the  optimal  policy  during  periods 
u,  u + 1 , . . . , v,  given  that  u and  v + 1 are  two  successive  capacity  points  with  idle  capacities 

«„  and  av+1.  The  second  term  is  the  optimal  cost  for  periods  v + 1,  v + 2 T,  given  av+). 

Thus,  searching  for  the  optimal  values  of  v and  av+)  results  in  /„(<*„).  As  shown  in  Figure  1, 
this  formulation  may  also  be  viewed  as  the  shortest-path  problem  for  an  acyclic  network  in 
which  the  nodes  represent  all  possible  values  of  capacity  points.  Each  node  is  described  by  two 
values  (t,  «,),  where  t is  the  time  period  and  a,  is  the  associated  capacity-point  value.  From 
each  node  (u,  au)  there  emanates  a directed  link  to  any  node  (v  + 1,  «v+1)  for  v > u with  an 
associated  cost  of  duv(au,  av+1).  It  can  be  shown  by  simple  enumeration  and  algebraic  manipu- 
lations that  the  total  numer  of  links  N in  Figure  1 is 

(6)  N - £ 2 R,  £ 2Rr  + T £ 2 R,  + 

(-2  r-/  + 1 i-2  2 

Most  of  the  computational  effort  involved  in  solving  (5)  is  spent  on  the  solution  of  the  sub- 
problems  (4). 


dir  (1.0 


d«  (1, 2Rj+1) 


dia  (1.1) 


dii  (1.  2R2+1 


Figure  I.  The  shonesi-palh  problem  equivalent  lo  ihe  dynamic-programming  formulation. 
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3.  THE  SOLUTION  FOR  NONNEGATIVE  DEMAND  INCREMENTS 

We  shall  first  characterize  several  properties  of  an  extreme-point  solution  of  problem  (1) 
when  r,,  > 0.  To  derive  these  properties  it  is  convenient  to  view  (1)  as  a single-commodity 
network  problem,  as  shown  in  Figure  2.  The  network  includes  a single  source  (node  0 ) with  a 
supply  of  R |.  There  are  IT  additional  nodes,  each  denoted  by  either  (/,/)  or  ( j.t ),  where  i (or 
j)  specifies  the  facility  and  t indicates  the  time  period.  At  each  node  ( /, / ) there  is  an  external 
demand  of  /•„.  The  nodes  are  connected  by  directed  links,  where  the  flows  along  these  links 
represent  the  construction,  conversion,  and  idle-capacity  variables.  Specifically,  the  nodes  are 
connected  as  follows: 

• A link  from  node  0 to  each  node  (/',/),  with  flow  x„; 

• A link  from  each  node  (/,/)  to  (i,i  + 1).  with  flow 

• A link  from  each  node  (/,/)  to  (/',/),  for  j * /,  with  flow  y„. 


It  can  be  shown  [1]  that  a feasible  flow  in  this  network  (satisfying  the  constraints  (1.2) 
through  (1.5))  corresponds  to  an  extreme-point  solution  of  problem  (1)  if  and  only  if  it  does 
not  contain  any  loop  with  positive  flows.  Since  ru  ^ 0,  one  may  observe  from  Figure  2 that  a 
feasible  flow  does  not  contain  any  such  loop  if  and  only  if  the  following  properties  are  satisfied: 


(7) 

(7.1) 

I H^it  * 0, 

(7.2) 

hyp  - o. 

(7.3) 

Xi,yJt  - 0,  J 

(7.4) 

y„yj,  - o. 

I - 1.  2, 
-1,20*  /), 
- 1,  2 T, 


We  shall  now  concentrate  on  the  computation  of  a subproblem  value  </„v(au,  av+))  as 
defined  by  (4)  which  satisfies  (7).  The  subnetwork  associated  with  the  subproblem  is  given  in 

Figure  3.  From  (7)  it  follows  that  x„  - y„  - 0 for  / - 1,  2 and  r — u + 1,  u + 2 v. 

Therefore,  only  xu,  x2„,  y\u,  and  ylu  may  be  positive  in  the  solution  of  (4). 


I 


! 


} 


I 


i 


L 


Let  D,  be  the  capacity  change  of  facility  / during  periods  u,  u + 1 v,  i.e.. 


(8) 


D<  - Z (*«  + y,t  - y,D  - /,V+|  + /*,(«,  v)  - / - i,  2, 


j - 1,  2 ^ /). 


Since  Z)|  + Z)2  = £ C-*- -t-  jc2/) , Z)t  + £>2  < 0 implies  that  at  least  one  of  the  variables 


x„  is  negative,  hence,  the  corresponding  subproblem  is  infeasible.  (An  infeasible  subproblem  is 
defined  as  a subproblem  for  which  there  is  no  solution  which  satisfies  constraints  (1.2)  through 
(1.5)  and  the  properties  of  (7).) 


Suppose  that  D,  + £>2  ^ 0,  /,„  = 0,  and  /2„  > 0.  From  (7.1),  x2„  - 0,  so  that 
*\u  ~ + D2.  From  (7.2),  ylw  = 0,  hence  £>2  = x2u  + y - ,y2l(  « - y2ll,  or  y2u--D2. 

The  subproblem  (4)  is  therefore  infeasible  for  two  cases:  D2  > 0,  or,  by  (7.3),  D2  < 0 and 
D\  + D2  r*  0.  For  all  other  values  of  D\  and  D2  the  subproblem  has  a unique  feasible  solution 
x\n  “ D\  + D2,  y2u  — —D 2,  and  x2u  — ylu  — 0.  The  optimal  value  of  the  subproblem  is  then 


V 2 


dllv(au,  av+|)  * C\U(D\  + Z?2)  + g2u(  D2)  + ^ A(((/l(+|), 


1-11 1-1 


where  the  idle  capacities  /,  ,+]  are  obtained  by  appropriate  substitutions  in  (1.2).  When  l2u  - 0 
and  / 1„  > 0,  the  solution  is  obtained  in  the  same  manner,  with  the  indices  1 and  2 inter- 
changed. 
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Assume  now  that  l[u  - /2„  - 0,  in  which  case,  by  (8),  Dx  ^ 0 and  D2  ^ 0.  Up  to  three 
feasible  solutions  may  then  exist: 

(a)  Xiu  - Dx.  x2u  - D2,  y\u  - 0,  and  y2u  - 0; 

(b)  - £>,  + D2,  x 2u  - 0,  ylu  - D2,  and  y2u  - 0; 

(c)  x \u  - 0,  x 2u  - /),  + Z>2.  - 0,  and  y2u  - £>,. 

The  costs  associated  with  each  of  these  policies  can  readily  be  computed,  and  the  policy  with 
the  smallest  cost  yields  duv(au,  av+1). 

A flow  chart  of  the  derivation  of  </l(V(a„,av+1)  is  given  in  Figure  4.  The  value  of  all  vari- 
ables not  shown  in  that  chart  is  fixed  at  zero,  and  the  value  of  rf„v(a„,  av+i)  when  the  subprob- 
lem is  infeasible  is  fixed  at  infinity. 


Figure  4.  Derivation  of  an  optimal  policy  for  a subproblem. 


As  a final  point,  it  can  be  shown  from  the  network  representation  in  Figure  2 that  (5) 
need  not  always  be  computed  for  all  possible  values  of  a„.  Specifically,  the  values  of  interest 
for  I„(i  — 1,2)  are 


R,(t.  t)  + R,(t 


0, 

I iU,  r),  j - 1,  2 O'  i), 

W,  r'),  I < r < T.  t < t'  < t,  t'  < r' 


Since  these  values  are  sums  of  demands,  this  observation  may  reduce  the  computational  effort, 
especially  when  the  demands  increase  linearly. 

4.  MODIFICATIONS  FOR  ARBITRARY  DEMAND  INCREMENTS 

When  the  r„’s  are  allowed  to  be  negative,  /,  r+1  may  be  positive  in  all  optimal  solutions  of 
problem  (1).  However,  since  all  cost  functions  are  nondecreasing,  there  exists  an  optimal  solu- 
tion in  which  /(r+1<  max  l/?,(l,f)l  — /?,(!, T).  Let  7"  — T + 1,  with  c,r(*) — 

Kt<r 
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g,r( •)  — h,r( • - 0 and  rlT  — max  l/J,(l,r)]  - R,(\,T).  Obviously,  any  optimal  solution  for 

the  T - period  problem  is  also  optimal  for  the  original  T-period  problem.  Furthermore,  there 
exists  an  optimal  solution  in  which  A.r+i  - 0 (/  - 1 ,2).  The  problem  is  then  solved  by  the 
dynamic-programming  formulation  (5),  where  R,  is  redefined  as  R,  - /?t(r,  T')  + R2(t,  T). 

The  difficulties  in  solving  (5)  arise  from  the  computational  effort  involved  in  solving  the 
subproblems  </„„(«„,  av+1).  When  the  r,'s  are  allowed  to  be  negative,  an  extreme-point  solu- 
tion (or,  equivalently,  a feasible  flow  on  the  network  given  in  Figure  2 which  does  not  contain 
any  loop  with  positive  flows)  does  not  imply  that  the  properties  of  (7)  are  satisfied.  However, 
if  we  examine  a subproblem  such  as  the  one  in  Figure  3,  the  following  properties  must  be 
satisfied  to  obtain  a flow  which  does  not  contain  any  loop  with  positive  flows: 

(10.1)  x,(|  x,,7  =*  0,  u < t2  4 v (/ 1 t2),  » 1,2; 

(10)  (10.2)  yltlyj,}  = o,  u < r |.  t2  < V,  i,  j - 1,2, 

and  either  / ^ j or  r2; 

(10.3)  Xi,1X2,7y„3  - 0,  u < t2,  t j < v,  / - 1,  2. 


For  example,  if  (10.1)  is  violated,  then  the  flows  x,(|,  /,,|+l /,(j,  x„2  (when  < t2)  form 

a loop  with  positive  flows.  Thus,  we  need  to  consider  only  subproblems  in  which  there  is  at 
most  one  new  construction  for  each  facility  (10.1)  and  at  most  one  conversion  (10.2).  Further- 
more, if  two  constructions  are  being  considered  (one  per  facility),  conversion  is  then  not 
allowed  (10.3). 


In  contrast  to  the  case  of  r„  > 0,  optimal  construction  and  conversion  may  take  place  on 
any  period  t,  u < / < v.  We  shall  now  summarize  the  possible  policies  (satisfying  the  con- 
straints of  (1)  and  the  properties  of  (10))  which  need  to  be  examined  in  order  to  solve 
</„v(a„,av+I).  These  policies  depend  on  the  capacity  change  D ,,  as  defined  by  (8),  and  are 
summarized  in  Table  1.  In  this  table  it  is  assumed  that  D\  + D2  > 0,  since  otherwise  the  asso- 
ciated subproblems  are  infeasible.  All  the  variables  not  mentioned  for  a given  policy  are  fixed 
at  zero,  and  t , and  i2  are  time  periods  between  w and  v.  The  dashes  represent  infeasible  reali- 
zations. 


To  solve  a subproblem  with  given  values  of  Z),  and  D2 , all  policies  shown  in  the  appropri- 
ate column  have  to  be  evaluated.  Feasible  values  of  t\  and  t2  include  all  values  which  satisfy 

the  constraints  /„  > 0 for  / — 1,  2 and  t - u + 1,  u + 2 v.  Hence,  a significant  amount 

of  computation  may  be  needed  to  obtain  all  feasible  policies  and  compare  the  costs  associated 
with  these  policies.  The  computational  effort  can  be  reduced  in  certain  cases,  for  example, 
when  the  cost  functions  are  uniformly  decreasing  with  r (such  as  cost  functions  which  depend 
on  / only  through  a discount  factor). 

As  a final  comment,  it  may  be  of  interest  to  examine  problems  where  /, , >0.  The 
dynamic-programming  equations  can  readily  be  applied  if  we  redefine  aq  — 1,  when  /n  and  l2 1 
are  equal  to  their  initial  nonzero  values,  and  the  derivation  of  rf„v(a„,av+|)  described  in  this 
section  can  be  used.  The  algorithm  can  also  be  extended  to  similar  models,  for  example,  when 
capacity  shortages  are  allowed. 
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Table  1.  Possible  Policies  for  Arbitrary  Demand  Increments 


D„  D2 

Policy 

O,  < 0 
D2>  0 

O,  > 0 
D2<  0 

0,-0 
d2>  0 

O,  > 0 
02  — 0 

C3  C3 

Ki  — 

V V 
o o 

0,-0 
Oj  — 0 

*>', 

— 

— 

0 

===== 

0 

Di 

0 

o2 

0 

D\  + D2 

— 

d2 

£>, 

O,  + Dj 

0 

D2 

°2 

0 

0 

— 

D,  + Dj 

d2 

0. 

o,  + Oj 

0 

y»i 

*>. 

0 

0, 

0 

*2,, 

D,  + f>2 

— 

o2 

— 

— 

0 

yx,2 

~D , 

0 

0 

*>', 

— 

z>,  + d2 

— 

0. 

_ 

0 

y*  2 

-d2 

0 

0 

5.  APPLICATION  TO  A CABLE-SIZING  PROBLEM 

Cable-sizing  problems,  described  in  the  introduction,  often  occur  in  network-planning 
applications.  We  assume  that  once  an  expensive  cable  (cable  1)  is  used  for  demand  associated 
with  a cheaper  cable  (cable  2),  it  cannot  be  reconverted  to  serve  demand  associated  with  the 
expensive  cable.  Given  the  demands  for  the  two  cables,  one  needs  to  plan  the  capacity  expan- 
sions. The  decisions  to  be  made  include  what  cables  should  be  installed,  when,  and  how  large 
they  should  be. 

We  shall  assume  that  all  demand  increments  are  nonnegative,  so  that  the  solution  tech- 
nique developed  in  Section  3 can  be  applied.  Since  cable  2 cannot  be  used  for  the  demand 

associated  with  cable  1,  y2,  - 0 for  t - 1,  2 T.  Therefore  l2l  < R2(t,  D,  and  the 

number  of  possible  values  of  capacity  points  (see  (2))  can  be  reduced.  Furthermore,  the  (low 
chart  described  in  Figure  4 can  be  simplified  as  follows: 

• When  /,„  - 0 and  l2u  > 0,  D2  ^ 0 implies  that  the  subproblem  is  infeasible. 

• When  /,„  - 0 and  l2u  - 0,  possibility  (c)  need  not  be  considered. 

The  model  has  been  applied  to  pairs  of  cables  chosen  from  four  types  of  cables.  The  con- 
struction cost  functions  are  approximated  from  discrete  data  points.  We  assume  that  these 
functions  are  composed  of  a fixed  cost  per  installation  (about  the  same  for  all  cable  types, 
slightly  varied  for  sensitivity  analyses)  plus  a constant  cost  per  wire  pair  (different  for  each 
cable  type).  Specifically,  we  assume 
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(a)  3600  + 60*.  (b)  4000  + 33*, 

(c)  4000  + 24x,  (d)  3700  + 18*, 

where  x is  the  number  of  wire  pairs  included  in  the  cable.  A single-year  discount  factor  of  0.93 
is  assumed  to  account  for  the  time  value  of  money.  Furthermore,  we  assume  that 
£„(•)  =■  //„(•)  = 0.  All  examples  are  for  a planning  horizon  of  T — 20  years. 

In  Table  2 we  show  examples  for  a linearly  growing  demand  (i.e.,  r„  is  the  same  for  all  r), 
where  the  demand  increments  are  chosen  to  represent  areas  with  moderate  growth.  Under  the 
"Installation"  headings,  1(2S0)  means  that  a cable  with  250  wire  pairs  is  installed  in  period  1. 
Under  the  "Conversions"  heading,  1-20  means  that  the  demand  increments  associated  with 
cable  2 for  periods  1-20  are  satisfied  by  cable  1. 


Table  2.  Examples  for  Linearly  Growing  Demands 


Installations  of  the 
Expensive  Cable  (Cable  I ) 


Installations  of  the 
Cheap  Cable  (Cable  2) 


Conversions 
from 
Cable  I 
to  Cable  2 


1(2501,6(250), 11(2501.16(250) 
l(250),6(250), 1 1(250), 16(250) 
I(270),6(2S0), 11(250),  16(250) 
1(500), 6(500),  11(500),  16(500) 
1(480), 7(560). 14(560) 
l(420),8(420).  15(360) 


1(500), 11(500) 
1(240), 13(160) 
3(180) 


1(250), 6(250). 
I (290), 6(250), 
I (275), 6(250), 
I (350)  ,6(350) , 


l (400)  ,8(350). 
I (430). 8(350), 
1(455), 8(350). 
1(440), 8(350), 
I (480), 7(560). 
1(3501,8(350). 
1(450). 7(525). 


11(250). 

11(290). 

11(275). 

11(350). 


1 5(300) 
15(300) 
15(510) 
15(480) 
14(560) 
15(300) 
14(525) 


16(250) 

16(250) 

16(250) 

16(350) 


I (350), 8(350),  15(300) 
2(360), 12,(360) 

2(225), 12(225) 


2(450), 11  (500) 
3(360),  1 2(360) 
4(385) 

4(330) 


1(330), 12(270) 


* "All  conversion"  policy  enforced, 
t "No  conversion"  policy  enforced. 

The  results  for  the  cables  with  cost  functions  (a)  and  (d)  suggest  that  the  demand  associ- 
ated with  each  cable  should  be  satisfied  primarily  by  installation  of  the  appropriate  cable.  In 
contrast  to  these  results,  when  cost  functions  (b)  and  (c)  are  assumed,  only  cable  (b)  is 
installed.  The  different  policies  result  from  the  differences  in  the  variable  costs  for  an  addi- 
tional wire  pair. 

The  examples  for  cost  functions  (a)  and  (b)  reveal  an  interesting  observation.  When  the 
demand  associated  with  cable  (b)  is  relatively  high  (about  2 5 wire  pairs  per  period,  or  more),  it 
is  satisfied  by  installing  cable  (b)  (except  for  minor  conversions).  However,  when  the  demand 
for  (b)  is  20  wire  pairs  per  period  or  less,  all  the  demand  is  satisfied  by  cable  (a).  Let  a mixed 
policy  be  one  in  which  the  demand  for  cable  2 is  satisfied  by  each  of  the  two  cables  for  a sub- 
stantial number  of  periods.  Thus,  a mixed  optimal  policy  may  only  exist  for  a narrow  range  of 
demand  increments  for  cable  (b),  somewhere  between  20  to  25  wire  pairs  per  period.  The 
results  for  cost  functions  (b)  and  (d)  also  indicate  that  the  range  of  demand  increments  for 
which  mixed  policies  are  optimal  is  quite  narrow. 
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The  examples  in  Table  2 suggest  that  a good  heuristic  is  to  choose  the  best  from  the  fol- 
lowing two  strategies: 

• The  optimal  policy  when  all  the  demand  is  satisfied  by  the  more  expensive  cable; 

• The  optimal  policy  when  all  demand  associated  with  the  cheaper  cable  is  satisfied  by 
installation  of  the  cheaper  cable. 

These  optimal  policies  can  be  found  by  applying  efficient  algorithms,  such  as  those  given  in 
[10],  designed  for  problems  with  a single  facility. 

The  model  has  also  been  applied  to  examples  with  convex  and  concave  growing  demands. 
The  results  again  suggest  that  good  heuristics  can  be  designed,  based  on  the  solution  of  several 
single-facility  problems  per  example.  The  examples  were  solved  on  an  IBM  370/168  computer, 
and  on  the  average  it  took  about  10  s to  solve  each  example.  About  3000  subproblems  with 
feasible  solutions  were  computed  in  I s.  Furthermore,  only  about  3%  of  the  subproblems  were 
feasible,  and  the  time  spent  on  infeasible  subproblems  was  negligible. 

Several  approximations  can  be  implemented  to  reduce  the  computational  effort,  for  exam- 
ple, 

• Consider  larger  increments  of  demand  as  one  unit; 

• Set  duv(.au,  av+I)  = °°  whenever  v - u < / (where  / is  a positive  integer);  i.e.,  limit 
the  number  of  constructions  and  conversions. 

Our  computational  experience  suggests  that  the  additional  objective-function  cost  incurred  by 
implementing  such  approximations  may  be  small. 
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ABSTRACT 

t " 

This  paper  discusses  a class  of  queueing  models  in  which  the  service  lime  of 
a customer  at  a single  server  facility  is  dependent  on  the  queue  size  at  the  onset 
of  its  service.  The  Laplace  transform  for  the  wait  in  queue  distribution  is 
derived  and  the  utilization  of  the  server  is  given  when  the  arrival  is  a homo- 
geneous Poisson  process. 


INTRODUCTION 

There  is  increasing  attention  in  the  queueing  literature  to  the  study  of  the  systems  in 
which  the  service  characteristics  change  dynamically  to  accomodate  variations  in  the  system 
state.  In  this  paper  we  wish  to  extend  Harris’  15,6]  two-state,  state-dependent  M/M/1  queueing 
model  to  the  two-state,  state-dependent  M/G/l  model,  where  the  service  time  of  a customer  is 
sampled  from  the  arbitrary  distributions  B(.)  or  B,(.),  depending  on  whether  there  are  any  cus- 
tomers behind  him  or  not  at  the  onset  of  his  service.  Harris  [5,6]  studied  the  M/G/l  queueing 
system  in  which  the  service  time  parameter  of  a customer  is  a stochastic  process  dependent  on 
the  number  in  the  queue  at  the  moment  his  service  is  begun.  Some  general  theory  was 
developed  and  three  special  cases  were  also  considered  in  [5,6].  One  of  them  is  the  two-state, 
state-dependent  M/M/1  model,  where  the  service  time  of  a customer  is  exponentially  distri- 
buted with  parameters  p.  or  p.u  depending  on  whether  there  are  any  customers  behind  him  or 
not  at  the  onset  of  his  service.  For  this  model,  Harris  obtained  the  probability  distribution  for 
the  number  in  the  system,  and  recently  Brill  and  Posner  [1]  used  system  point  theory  and 
obtained  the  distribution  function  for  the  waiting  time. 

In  this  note,  using  the  appropriate  embedded  Markov  chain,  the  Laplace  transform  for  the 
waiting  time  in  the  two-state,  state-dependent  M/G/l  queue  will  be  obtained.  It  will  also  be 
shown  that  the  result  obtained  by  Harris  [5]  for  the  probability  of  no  waiting  is  independent  of 
•the  form  of  the  distribution  function  B(.),  as  long  as  Z?^.)  is  exponential. 

GENERAL  MODEL 

Consider  arrivals  of  customers  at  a single  server  facility  at  times  t,, r2,  ... 
(t0-0<t,<t2<  ...),  and  let  Tn  - t„-t„.|(b  - 1,2,  ...),  so  that  Tn  denotes  the  interar- 
rival time  between  the  (n-1)"'  and  n customers.  Customers  are  serviced  in  order  of  arrival. 
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Let  Sn  denote  the  service  time  and  W„  denote  the  waiting  time  in  the  queue  of  the  n'h  arriving 
customer  measured  from  the  time  he  joined  the  queue  until  the  instant  he  enters  service. 
Throughout  this  paper  we  shall  use  F„(w)  — Pr{  Wn<  w). 

Using  the  imbedded  Markov  chain  approach  with  respect  to  the  sequence  { W„)  of  waiting 
times  in  the  queue,  we  may  easily  write 

(l)  K+x-lK  + s„-  r„+l]\ 

where  [y]+  - max(0,y). 

A Queue  with  Service  Time  Depending  on  the  Number  in  the  System. 

Customers  arrive  at  a single  server  facility  at  times  T|,t2,  . ..(t0  — 0<T|<t2<  ...),  and 
T„  - t„  — ...)  denotes  the  interarrival  time  between  the  (n-1)"'  and  n"'  custo- 

mers. In  this  paper  we  shall  assume  that  the  sequence  \ Tn)  represents  a set  of  mutally  indepen- 
dent and  identically  distributed  random  variables  with  common  distribution  function  A (.). 
Customers  are  serviced  in  the  order  of  arrival.  The  n"'  arriving  customer  receives  a service  of 
S„  , where  Pr{S„  ^ x|  = £,(x)  if  no  newly  arrived  customers  are  behind  him  at  the  onset  of 
his  service,  and  Pr{S„  < x)  « B(x)  if  at  least  one  customer  is  behind  him  at  the  onset  of  his 
service. 

This  example  with  homogeneous  Poisson  arrival  and  general  service  time  has  been  con- 
sidered by  Harris  (5,6j.  Brill  and  Posner  fll  have  considered  the  same  problem  with  exponen- 
tial service  times. 

From  (1),  for  w > 0 and  n — 1,2 we  have 

Fn+1(w)  = Pr{  ^„  + - 7'n+1<w) 

and,  rewriting, 

F„+1(w)  - Pr{S„<w  + r„+ 1 - Wn\. 


Now,  conditioning  on  the  interarrival  time  T„+x(  =>=  x - w)  and  waiting  time  Wn(  - a),  we  get 
F„+,(w)  - f f Pr(S„<x  - a|  Wn  - a,T„+\  - x-w]<tFn(a)dA(x-w). 

Since,  by  definition  of  the  model. 


Pr{S„<x-al 


B\(x— a),  a<x—w, 
B(x-a),  a^x-w, 


we  can  rewrite  the  above  equation  for  F„+]( w)  as  follows: 

(2)  F„+l(w)  - f f Bx(x  - a)  dF„(a)dA(x-w) 

•Sx-w^a  m 0 - 

+ f f B(x  - 0t)dF„(a)dA(x  - w),w  > 0. 

w.if-iy  •'a  — x — W 

F„+ j (0)  may  be  found  from  the  condition  F„+1( »)  - j. 


In  more  general  cases,  equation  (2)  is  difficult  to  investigate  thoroughly.  Attention  will 
therefore  be  focused  on  the  analysis  of  more  specific  subclasses  of  models.  If  we  assume  that 
the  arrivals  represent  a homogeneous  Poisson  process  of  rate  X,  then  A (z )— 
1 - expf  - Xz),z  > 0. 
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In  the  following  analysis  we  will  assume  that  the  arrivals  represent  a homogeneous  Pois- 
son process  with  rate  X.  For  w > 0,  let  the  probability  density  function  /„( w)  - dF„iw)/dw, 
assuming  that  F„iw)  is  continuous  and  differentiable  for  w > 0,  and  for  w - 0 ,/0„  - F„( 0)  is 
the  probability  that  the  n customer  does  not  wait  in  the  queue.  Differentiating  equation  (2) 
with  respect  to  w,  with  dA  ( z ) - X exp(  - X z)dz,  we  get 

(3)  /»+ i(w)  - ~ Jx_w  Bxiw)f„ix  - w)dA  Or  - w)  - X Bi(w)f0„ 

+ X J*  f B\{x  — a)dF„ia)dAix  — w) 

Jx-wJa-o~ 

+ J*  Biw)fnix  - w)dAix  - w)  + X B ( w)/0 „ 

J X — W 

+ X f f B(x  - a)dF„(a)dA  (x  - w) 

- f X Biw  - a)dFnia). 

Ja-0- 


Substituting  (2)  in  (3)  for  /■„+,(*)  and  L„i  X ) - f exp(  - X a)dF„ia)  - 

(1/  X ) Jq  fnia)dA  (a)  + f0  „,  we  get 

(4)  fn  + ,(w)  - X F„  + ,(h>)  - J*  X - a)dF„ia)  + X lfl(w)  - fil(w)]LB(  X ). 


Assuming  now  that  the  limiting  distribution  exists,  the  sequence  {Fj  will  converge  uni- 
formly to  F.  Let  Fiw)  — lim  Fniw)  and  fiw)  - dF(w)/dw  for  w>0.  The  stationary  waiting 

n — *oo 

time  distribution  may  then  be  written  from  (4)  as  and 

(5)  /( h>)  - X Fiw)  - f X Biw  - a)dF(a)  + X (fl(w)  - X ) 

•'a-0- 

- X f*  [1  - Biw  - a)]dFia)  + X [A(w)  - £,(w)]I(  A ). 

J r.  - n - 


where 


L(  X ) — exp(  — X a)dFia). 


Now,  multiplying  both  sides  of  equation  (5)  by  exp  ( — sw)  and  integrating  over  w from  0 
to  °°,  we^get  Lis)  - f0  - { X [1  - fl*(s)]I(s)}/s  + { X [fl*(s)  - #,’(s)]L(  X )}/s,  where 
Lis)  — o exp(  - sw)dFiw)  is  the  Laplace  transform  of  the  waiting-time  distribution 

B*is)  - f exp(  - sw)dBiw),B[is)  - f exp(  - sw)dByiw)  and  /0  - FiO). 

J HP-0  J HP  - 0 


Now,  solving  for  Lis ),  we  have 

(6) 


Lis)  - 


X [g*(s)  - li'(s)ll(  X ) +sf0 
s - X [1  - 


Substituting  s - X in  (6)  and  using  the  condition  lim  Lis)  — 1,  we  will  get  two  equa- 

s — 0 

tions  for  the  unknowns  L ( X ) and  /<>  Solving  these  two  equations,  we  get 

/„-  (1  - p)B,*(  X )/lp,  - p + ff,*(  X )] 


i 
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and 

1(A)  -0  - p)/lp,  - p + B,*(  A )]. 

where 

p - A xdB(x)  and  pt  - A xdBt(x). 

Let  U be  the  utilization  of  the  server;  then 
U-\-fQ 

- {p,  - pll  - B,*(  A )1}/[Pi  - p + B{(  A )J. 

The  mean  waiting  time  Wq  in  the  queue  is  then 
W.~  lim[  - dL(s)/ds) 

i —o 

_ WqBK  a ) - (1  - p,)  w0  + (1  - p)  wj 

a -p)ip,-p  + j?;(a)] 

where 

W0-  ( A ID  x2dB(x)  and  B"0-  (A/2)/o°°  x2dB^x). 

THE  M/M,  G/l  MODEL 

When  the  distribution  of  service  time  B t(.)  is  exponentially  distributed  with  parameter  p, 
such  that  Bt(z)  — 1 — exp(piz),z  > 0,  and  B(.)  is  still  an  arbitrary  distribution  function,  we 
get 

/o-  (1  - p)/(l  - p + Pi  + pt2  - p,p). 


The  above  result  was  first  obtained  by  Harris  [ 5,6]  with  the  exponential  assumption  for 
A (.),/?(. )(andfl](.).  The  above  result  shows  that  it  is  independent  of  the  form  of  distribution 
for  B(.).  We  also  have 

w _ woP\P\  + (1  ~ p)(l  + Pl>Pi 
" p^l  - p)(l  - p + p,  + p,2  - p,p) 


! 


THE  M/M,  M/1  MODEL 

When  B(x)  — 1 — exp(  — px)  and  Bt(x)  — 1 — exp(  — pix),  for  x>0,  we  can  easily 
derive  the  waiting  time  distribution  from  equation  (5)  using  differential  operators,  as  done  in 
111. 
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ABSTRACT 

In  the  slu  ly  of  complex  queueing  systems,  analysis  techniques  aimed  at 
providing  exact  solutions  become  ineffective.  Approximation  techniques  pro- 
vide an  attractive  alternative  in  such  cases.  This  paper  gives  an  overview  of 
different  types  of  approximation  techniques  available  in  the  literature  and 
points  out  their  relative  merits.  Also,  the  need  for  proper  validation  pro- 
cedures of  approximation  techniques  is  emphasized. 

INTRODUCTION 

Queueing  theory  has  passed  through  several  stages  in  its  growth.  During  the  first  three 
decades  of  this  century  pioneering  work  was  done  in  its  foundation.  Major  analysis  techniques 
for  the  investigation  into  the  behavior  of  Markovian  systems  were  developed  during  the  next 
two  decades.  The  1950’s  saw  investigations  extended  into  problems  related  to  non-Markovian 
systems.  This  trend  continued  well  into  the  middle  of  the  sixties.  Until  then,  queueing  theory, 
having  been  developed  by  mathematicians,  probabilists,  and  statisticians,  had  grown  with 
minimal  interaction  with  applications.  During  the  past  ten  years,  the  trend  has  been  more 
toward  applications  and  making  queueing-theory  results  applicable.  The  two  major  areas  receiv- 
ing maximum  attention  during  this  period  are  optimization  problems  in  queues  and  approxima- 
tion techniques  in  the  solution  of  queueing  problems. 

As  the  complexity  of  the  systems  being  considered  by  applied  scientists  increases,  finding 
effective  solution  techniques  leading  to  exact  solutions  is  becoming  a difficult  task.  Approxima- 
tion techniques  provide  an  attractive  alternative  in  such  cases.  Over  the  years  several  types  of 
approximation  techniques  have  been  developed  for  the  solution  of  queueing  problems.  It  is  our 
intention  here  to  provide  an  overview  of  these  techniques  and  discuss  their  relative  merits. 

Three  different  stages  may  be  identified  in  the  modeling  and  analysis  of  a queueing  sys- 
tem. At  the  first  stage  a suitable  mathematical  model  for  the  system  is  developed.  The  second 
stage  concerns  the  identification  of  and  investigation  into  the  basic  process  underlying  the 

Research  work  of  the  first  two  authors  was  supported  by  the  ONR/DCEC  Contract  N00014-75-0597,  NR042-324. 
Reproduction  in  whole  or  in  part  is  permitted  for  any  purpose  of  the  U.S.  Government. 
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model.  At  the  third  stage  numerical  results  are 
ing  that  an  approximation  can  be  introduced  at 
major  categories  of  approximation  techniques, 
and  numerical  approximation. 


obtained  from  the  analysis  of  the  process.  Not- 
any  one  of  these  stages,  we  may  identify  three 
system  approximation,  process  approximation. 


In  the  following  sections  we  shall  discuss  different  techniques  used  in  approximations  for 
the  solutions  of  queueing  problems  based  on  the  above  categorization.  Since  justifying  approxi- 
mate results  is  an  integral  part  of  the  process,  techniques  for  validating  approximations  are  also 
discussed.  Finally,  comments  are  made  about  future  prospects  in  this  direction. 


It  should  be  pointed  out,  however,  that  the  objective  of  the  paper  is  not  the  categoriza- 
tion, but  the  understanding  of  different  types  of  approximating  procedures.  As  will  be  clear 
later,  even  though  the  approximation  is  initiated  at  a certain  stage,  that  the  net  result  is  to 
impact  the  system  at  all  stages  of  analysis.  Consequently,  the  distinction  between  the  tech- 
niques sometimes  becomes  unclear. 

For  purposes  of  convenience  we  use  Kendall  notation  suitably  modified  to  include  finite 
capacity.  For  instance,  A/B/C/D  represents  a system  in  which  the  symbols  A,  B,  C,  D stand 
for  the  interarrival  time  distribution,  service  time  distribution,  number  of  servers,  and  system 
capacity  respectively.  When  dealing  with  systems  with  no  limitations  on  capacity,  D is  dropped. 
Also,  the  time  dependence  of  an  element  is  indicated  by  writing  it  as  a function  of  t. 

In  compiling  a bibliography,  the  intention  of  the  authors  has  been  to  include  a representa- 
tive list  of  references.  We  have  also  tried  to  be  exhaustive,  so  as  to  make  it  useful  to  the 
reader.  All  omissions  of  significant  papers  are  inadvertent  rather  than  intentional. 

SYSTEM  APPROXIMATION 

A system  approximation  is  mainly  a simplification  of  the  system  under  study  such  that  the 
behavior  of  the  new  system  is  strongly  related  to  the  original  system.  The  four  main  elements 
in  a queueing  system  are  the  arrival  process,  the  queue  discipline,  the  service  process,  and  the 
system  structure.  These  elements  are  described  by  their  properties  or  attributes.  Also,  due  to 
the  complexity  of  some  applications,  such  as  networks  of  queues,  we  need  to  add  a set  of  rela- 
tions that  hold  among  these  elements  which  are  the  results  of  various  assumptions.  Hence,  a 
system  simplification  may  be  characterized  either  as  simplifying  the  system  elements  or  relaxing 
the  relational  assumptions. 

Simplification  of  system  elements  is  at  the  heart  of  the  practice  of  queueing  theory.  Many 
times,  results  may  not  be  available  for  the  exact  representation  of  the  system  element  model 
(such  as  the  distribution  for  interarrival  time  or  service  time).  Then  the  best  available  model  is 
used  to  arrive  at  the  best  approximate  result.  The  predominant  use  of  the  exponential  distribu- 
tion in  practice  is  due  to  this  approximating  process.  In  an  attempt  to  incorporate  more-general 
interarrival-time  and  service-time  distributions,  Erlangian  distribution  and  Erlangian  mixtures 
have  been  extensively  used.  In  this  regard  the  papers  by  Luchak  (68),  Wishart  1103],  Kotiah  et 
al.  (63),  and  Schassberger  [95]  are  significant.  The  first  three  of  the  above  papers  supply  the 
practicality  of  the  approach,  whereas  the  last  paper  provides  the  theoretical  basis  for  the  pro- 
cedure. 


A common  technique  in  system  approximation  is  the  use  of  a simpler  system  either  to 
derive  an  approximate  measure  of  performance  or  suitable  grounds  for  them.  For  instance, 
Maaloe  [69]  uses  simple  relations  existing  between  mean  waiting  times  of  M/M/I  and  M/M/s 
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systems  to  provide  an  approximate  value  of  the  mean  waiting  time  in  an  M/Ek/s  system.  Gross 
[361  examines  the  effect  of  using  an  M/M/s  model  to  approximate  a G/G/s  model.  His  results 
indicate  that  when  one  estimates  mean  value  measures  of  congestion,  the  sensitivity  to  the 
exponential  assumption  is  more  pronounced,  whereas  it  is  not  as  pronounced  for  cost  optimiza- 
tion models.  Chandy  et  al.  [16,17]  study  a queueing  network  with  a direct  application  of 
Norton’s  theorem  which  implies  that  the  properties  of  a subsystem  in  a queueing  network  can 
be  obtained  by  replacing  all  queues  that  are  not  of  interest  by  a single  queue  with  equivalent 
load  characteristics  (see  also  Sauer  and  Chandy  [94]).  Another  approach  in  the  treatment  of 
queueing  networks  occurring  in  computer  systems  is  that  of  Avi-Itzhak  and  Heyman  [3],  First, 
exact  results  are  obtained  for  a closed-system  model  in  terms  of  cycle  times  and  server  utiliza- 
tion. These  results  are  then  used  to  develop  approximate  results  for  an  open-system  model. 
For  other  examples  of  the  use  of  simpler  systems  see  Ghosal  [34]  and  Rosenshine  [90], 

Nonstationarity  of  the  arrival  process  can  also  be  effectively  handled  through  approxima- 
tions. Moore  [78]  provides  methods  for  partitioning  the  time  axis  into  intervals  with  stationary 
characteristics  and  approximates  an  M(t)/G/1  queue  by  an  M/G/l  queue  during  these  periods. 

Using  simpler  systems,  upper  and  lower  bounds  for  system  performance  measures  have 
been  derived  in  several  cases.  Brosh  [13]  derives  mean  total  time  spent  by  a customer  in  a 
priority  queueing  system  by  essentially  changing  the  priority  level  of  the  customer  so  as  to  pro- 
vide a worse  case  and  a better  case.  Brumelle  [14]  obtains  bounds  for  mean  waiting  time  in  a 
G/G/s  system  by  constructing  two  single-server  systems;  one  of  them  uses  a share  of  the  origi- 
nal load  to  give  an  upper  bound  and  the  second  uses  a service  rate  s times  faster  than  the  origi- 
nal one  to  give  a lower  bound.  A further  improvement  on  the  upper  bound  for  mean  waiting 
time  in  the  system  G/M/s  is  obtained  by  Brumelle  [15]  by  the  waiting  time  in  an  associated 
G/M/l  queue.  Yu  [104]  bounds  a multiserver  queue  with  recurrent  input  and  Erlang  service 
times  by  a simple  G/Ek/l  queue.  Kotiah  [62]  uses  a linear  programming  technique  to  provide 
bounds  in  Markovian  systems. 

In  a series  of  articles,  Stoyan  ([97]  and  references  cited  in  it)  has  studied  internal  and 
external  monotonicity  properties  of  systems  G/G/l  and  G/G/s.  The  internal  monotonicity  pro- 
perty refers  to  the  properties  of  characteristics  such  as  waiting-time  distribution  functions  over  a 
discrete  index  parameter,  and  the  external  monotonicity  property  refers  to  the  relationship  of 
the  monotonicities  of  element  (input  and  service)  distributions  to  the  queue  characteristic  dis- 
tributions. These  properties  can  be  used  to  provide  approximations  for  complex  systems  by 
finding  comparable  ones  that  are  easier  to  analyze.  An  excellent  review  of  these  results  is  given 
in  Stoyan  [97]  which  includes  a bibliography  of  sixty-seven  articles,  more  than  half  of  which  are 
not  found  in  English  language  journals.  Two  other  recent  papers  on  this  topic  are  Rolski  and 
Stoyan  [89]  and  Bergman  and  Stoyan  [6], 

Simpler  bounding  systems  can  be  obtained  by  modifications  to  the  queue  discipline. 
Under  low  traffic  situations,  Bloomfield  and  Cox  [12]  obtain  lower  bounds  for  mean  waiting 
time  by  ignoring  the  waiting  times  of  customers  other  than  the  one  being  considered.  In  the 
context  of  a traffic  queue  at  a signalized  road  intersection  Bhat  and  Prabhu  [9]  obtain  upper  and 
lower  bounds  by  sweeping  the  traffic  arriving  during  a green  period  to  the  right  and  left  extrem- 
ities of  the  period  (see  also  Bhat,  Wheeler,  and  Fischer  [11]). 

Replacing  a general  distribution  by  one  that  has  the  same  moments  is  an  appealing 
approach.  Kuczura  [64]  approximates  the  overflow  process  of  an  M/M/s/s  system  by  an  inter- 
rupted Poisson  process  which  is  alternatively  turned  on  and  off  for  exponentially  distributed 
lengths  of  time.  The  approximation  is  obtained  by  matching  the  first  two  or  three  moments  of 
the  two  processes.  To  study  the  mean  waiting  time  of  a G/G/l  queue,  Marchal  and  Harris  [73] 
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use  an  Ek/E/ 1 queue  and  match  the  first  four  moments  of  the  random  variable 
the  difference  (service  time  - interarrival  time). 


representing 


A problem  of  great  interest  in  telephone  work  relates  to  predicting  the  blocking  probabil- 
ity of  an  overflow  stream  of  traffic  in  a group  of  channels  operating  as  a loss  system.  An 
approximation  widely  used  is  the  equivalent  random  method,  which  replaces  the  system  under 
consideration  by  an  equivalent  loss  system  with  a Poisson  input.  For  details  of  this  method  see 
Wilkinson  [101],  Cooper  [20],  and  Holtzman  [46], 

There  are  queueing  systems  in  which  more  than  one  class  of  customers  share  the 
resources.  A relatively  simple  procedure  to  derive  the  performance  measures  of  such  systems 
is  to  consider  the  two  classes  separately  and  improve  the  accuracy  of  approximation  by  succes- 
sively using  the  most  recent  results  for  one  class  in  the  derivation  of  results  for  the  other  (see 
Bhat  and  Raju  [10]). 

For  approximating  more  complex  systems,  many  of  these  different  characteristics  could  be 
used  at  different  stages.  Some  examples  of  such  efforts  may  be  found  in  papers  such  as 
Leibowitz  [67],  Halfin  [39],  Willemain  [102],  and  Rosenshine  and  Chandra  [91]. 

Many  system  approximations  are  heuristic  in  nature.  The  quality  of  such  procedures 
depends  very  much  on  intuition  and  creativity.  The  justification  for  the  use  of  heuristic 
methods  is  not  that  they  are  analytically  sound,  but  that  experimentation  has  proved  they  are 
useful  in  practice.  The  basic  approach  is  to  observe  the  system,  to  relate  it  to  some  other  sys- 
tem with  known  behavior,  and  then  to  make  an  educated  guess  about  the  behavior  of  the  origi- 
nal system.  For  instance,  Cosmetatos  [21]  derives  approximate  formulae  for  the  steady-state 
queue  size  and  waiting-lime  distribution  in  the  system  GI/M/s  by  observing  the  similarity  of 
the  mean  waiting-time  curves  drawn  against  the  coefficient  of  variation  of  the  interarrival-time 
distribution,  when  the  traffic  intensity  is  kept  constant  for  different  numbers  of  servers.  By 
this  procedure  he  obtains  approximate  results  that  are  within  5%  of  the  actual  value.  Bhat  and 
Fischer  [8]  have  derived  approximate  results  such  as  blocking  probability  and  waiting  time  in  a 
two-class  heterogeneous  multiserver  system  with  Poisson  arrivals,  in  which  one  class  acts  as  a 
loss  system  but  the  second  acts  as  a delay  system.  A key  to  this  procedure  is  the  observation 
that  the  probability  of  blocking  is  relatively  insensitive  to  the  ratio  of  the  service  rates  of  each 
class,  which  allows  them  to  assume  equal  service  rates.  Conolly  [19]  considers  Poisson  queues 
belonging  to  the  class  of  generalized  birth  and  death  processes  as  essentially  renewal  models 
with  "effective"  interarrival  and  service  times  (actual  intervals  may  be  dependent  on  queue 
size). 


Nozaki  and  Ross  [86]  provide  an  approximation  for  mean  waiting  time  in  a multiserver 
queue  M/G/s  by  assuming  the  equilibrium  distribution  form  for  the  remaining  service  time  of 
customers  in  service  at  the  time  of  arrival.  The  expression  involves  the  distribution  of  the 
number  of  busy  servers,  for  which  an  approximate  formula  similar  to  the  exact  distribution  in 
the  queue  M/M/s  is  derived. 

Given  above  are  only  some  examples  of  the  use  of  heuristic  approaches  in  approxima- 
tions. To  some  extent  all  approximations  can  be  considered  to  have  some  heuristic  elements  in 
it;  but  in  system  approximations  they  are  in  abundance. 

PROCESS  APPROXIMATION 

Representation  of  a mathematical  model  follows  the  identification  of  the  system  model. 
Many  times,  the  basic  process  underlying  the  mathematical  model  is  so  complex  that  a direct 
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analysis  does  not  become  worthwhile  for  the  situation.  One  alternative  would  be  to  simplify  the 
system  model  itself  as  described  above.  The  second  alternative  is  to  identify  a simpler  process, 
whose  analysis  is  either  known  or  can  be  derived,  that  has  properties  similar  to  the  basic  pro- 
cess. Diffusion  approximation,  fluid  approximation,  and  the  use  of  asymptotic  or  limiting 
results  are  examples  of  such  procedures.  System-approximation  techniques  described  in  ihe 
previous  section  can  also  be  looked  upon  as  a form  of  process  approximation  when  the  availa- 
bility of  a simpler  underlying  process  is  the  motivation  for  such  an  effort.  System  approxima- 
tion techniques  suggested  by  Moore  [78]  and  Bhat  and  Prabhu  [9]  are  examples  of  such  situa- 
tions. 


Fluid  approximation,  as  suggested  by  Newell  [84]  is  mostly  an  engineering  approach.  It 
starts  with  some  crude  and  naive  estimates  and  relationships  between  system  elements,  and 
improvements  are  made  in  them  as  the  analysis  proceeds.  The  essential  concept  is  to  consider 
the  arrival  and  departure  processes  in  the  system  as  fluid  flowing  in  and  out  of  a reservoir. 
Because  of  its  deterministic  nature,  when  the  ouput  rale  (service  rate)  is  in  excess  of  the  input 
rate  (arrival  rate),  the  fluid  approximation  results  in  an  empty  queue.  In  view  of  this,  a proper 
setting  for  its  application  would  be  a short-term  analysis  of  a queue  or  the  behavior  of  an  over- 
saturated queue  (when  the  arrival  rate  exceeds  the  service  rate).  Also,  the  particular 
significance  of  its  usage  would  be  when  the  arrival  and  service  rates  are  time  dependent.  Then, 
if  Ail)  and  Dil)  are  the  arrival  and  departure  processes,  with  rates  A (/ ) = dAit)/dt  and 
nit)  — dD(t)/dt , respectively,  an  approximate  expression  for  the  queue  length  QU ) at  time  t 
can  be  given  as 

00)  = 0(0)  + A(t)  - DO) 

= 0(0)  + J*q  \(t)  dr  — J*o  /i.(r)rfr. 


A stochastic  analogue  of  the  fluid  approximation  is  the  diffusion  approximation.  In  this 
procedure  we  replace  a queueing  process  with  jump  transitions,  or  with  continuous  and  jump 
transitions,  by  a continuous  process  which  reflects  the  main  characteristics  of  the  original  pro- 
cess. Diffusion  processes  are  governed  by  stochastic  differential  equations  incorporating  the 
infinitesimal  mean  and  variance  of  the  process.  Let 

£(00  + t)  — 0(/)|  = f [A(jt ) - n ,(x)]dx 

~ [A (r)  - /i(t)]r, 

where  the  arrival  and  departure  rates  A (r)  and  n it)  are  considered  to  be  nearly  constant  over 
time  as  compared  to  r.  The  quantity  A (/)  — /*( t ) is  known  as  the  infinitesimal  mean  of  the 
process  at  time  t.  Also,  let 

a-2(i ) = Var  |0(H-t)  - 0O))/r 

be  the  infinitesimal  variance  of  the  process.  If  we  denote  the  distribution  of  the  process  00) 
by  fix,  i)  (note  that  0 (/)  is  considered  to  be  a continuous  process  in  this  approximation), 
under  this  approximation  the  function  fix,  t)  is  assumed  to  satisfy  the  Fokker-Planck  equation 

Bfix.i)  t,  t .\  i.\ i Bfix.i)  , cr2(t)  &ix,  t) 

— Bt  MU)1  8x  + 2 ax2  • 

Diffusion  approximation  is  usually  related  to  heavy  traffic  (service  rate  close  to  the  arrival  rate), 
since  we  need  the  time  variable  to  be  large  as  compared  to  intervals  between  transitions.  Under 
heavy  traffic,  idle  periods  occur  very  infrequently,  and  therefore  one  could  use  the  zero  state  as 
a reflecting  barrier  of  the  process  without  degrading  the  approximation  much  further.  (Note 
that  a diffusion  process  can  drift  toward  states  below  zero,  whereas  a queueing  process  remains 
on  the  nonnegative  side  of  the  axis.) 
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The  equilibrium  distribution  of  the  resulting  process  can  be  derived  in  most  cases  as 
/(*)  — lim  f(x.  /).  If  necessary  it  can  be  discretized  by  integrating  it  over  the  unit  interval 

l—oo 

n <x<ff  + l,or/i  — 0.5<jr<n  + 0.5. 

Gaver’s  analysis  132]  of  the  virtual  waiting  time  of  an  M/G/l  queue  is  one  of  the  initial 
efforts  using  diffusion  approximation  for  queueing  systems.  In  this  case  the  infinitesimal  mean 
and  variance  for  the  process  are  KE(S)  — 1 and  A £(S2),  respectively,  where  S is  the  service 
time.  Newell  [83]  gives  an  extensive  treatment  of  a time-dependent  arrival  process  using  the 
Fokker-Planck  equation.  Heyman  [42]  has  extended  Gaver’s  results  to  study  the  busy  period 
of  the  queue  M/G/l.  The  transient  behavior  of  the  G/G/l  queue  has  been  approximated  by 
Heyman  [43],  and  the  approximation  has  been  extended  to  the  G/G/k  system  by  Halachmi  and 
Franta  [38]  by  similar  techniques.  If  we  denote  the  interarrival  time  by  A and  the  service  time 
by  S,  for  G/G/l  the  infinitesimal  mean  and  variance  are 


\0)  - fiU) 


E(A)  E(S) 


Var(/Q  Var(S) 

[£(/4)]3  [£(S)13  ' 


For  the  queue  G/G/k,  these  take  the  form 


Var(/Q  min  (x,  k ) Var(S) 

[£(/f)]3  l£(S)]3 


where  x is  the  state  of  the  system. 


Some  of  the  other  applications  of  diffusion  approximation  in  queues  can  be  found  in 
Newell  [85],  who  provides  a general  setting  for  the  analysis  of  the  behavior  of  a sequence  of 
servers  in  series  with  finite  storage  in  between.  Other  references  that  suggest  and  elaborate  ear- 
lier applications  can  be  found  in  Kimura  [52],  Newell  [82],  Cox  and  Miller  [22]  and  Feller  [25], 

Diffusion  approximation  has  also  been  successfully  employed  in  the  analysis  of  queueing 
networks.  Appropriate  references  in  this  area  are  Kobayashi  [58,59]  and  Reiser  and  Kobayashi 
[87].  Fischer’s  use  of  the  procedure  in  analyzing  alternating  priority  queues  [26]  and  Gaver 
and  Shedler’s  (1973)  application  in  obtaining  the  processor  utilization  in  a multiprogramming 
computer  system  [33]  are  evidence  to  the  effectiveness  of  this  approximation  technique  (see 
also  [27,28]). 


A different  approach  will  be  to  observe  that  the  process  under  study  converges  in  some 
sense  to  a diffusion  process.  Iglehart  [47]  has  shown  that  in  the  M/M/n  queue,  if  we  let  the 
mean  interarrival  time  approach  zero  as  //—»<»,  then  the  queue  length  process  (after  proper 
scaling)  and  normalizing  tends  to  the  Omstein-Uhlenbeck  process.  McNeil  [77]  considers  a 
sequence  of  nonstationary  birth  and  death  processes  (**  (/))  with  input  and  output  rates  depen- 
dent on  N.  He  has  shown  that  lim  xN(l)  (after  normalizing)  corresponds  to  a nonstationary 

N—ao 

Ornstein-Uhlenbeck  process.  An  additional  reference  in  this  class  of  efforts  is  Harrison  [40], 
who  considers  a sequence  of  systems  with  increasing  traffic  intensities. 
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NUMERICAL  APPROXIMATION 

Numerical  approximation  can  be  defined  as  a simplification  which  is  brought  in  while  one 
actually  manipulates  the  arithmetic  expressions,  leading  to  an  evaluation  of  a certain  measure. 
If  we  identify  an  approximation  x as  x - x + 8,  where  x is  the  corresponding  exact  value  and  5 
is  an  unknown  small  quantity,  then  we  call  ra  "point  approximation"  if  5 is  unrestricted  in  sign, 
and  we  call  x a "one-sided  approximation"  (or  an  interval  approximation)  if  8 is  retricted  in 
sign.  Clearly,  the  more  we  know  about  the  properties  of  8 the  more  reliable  the  approximation 
will  be,  and  we  would  like  8 to  be  as  small  as  possible. 

The  queue  G/G/l  presents  many  difficulties  in  deriving  exact  results  for  its  performance 
measures.  Several  attempts  have  been  made  to  obtain  approximations.  The  more  successful  of 
these  are  the  heavy-traffic  approximation  (a  point  approximation)  and  upper  and  lower  bounds 
(giving  an  interval  approximation)  for  the  mean  waiting  time  given  by  Kingman  [53-551, 
Marshall  [74,751,  and  Suzuki  and  Yoshida  [981.  All  these  efforts  are  based  on  the  fundamental 
relation 

IV„+i  = max[0,  Wn  + S„  + T„], 

where  W „ is  the  waiting  time  of  the  n customer,  S„  is  his  service  time,  and  T„,  the  time  inter- 
val between  the  ( n — 1)”  and  the  n'h  cutomer.  Writing  U„  = S„  — T„  and  denoting  the  idle 
period  by  /,  one  gets  the  result 

(1)  , , fU/2]  "qEM 

1 J -2E[U]  -2 ElU]' 

where  ir0  is  the  probability  that  an  arrival  finds  the  system  empty,  lim  W„  = IV,  and 

n—oo 

lim  U„  = U.  Since  exact  values  for  £[/]  and  £[/2]  are  not  available  except  in  cases  such  as 

n—oo 

exponential  interarrival  times,  an  upper  bound  for  E[  W)  can  be  obtained  as 


E[W]  < 


Vartr]  + Var[Sl 


1 J ^ 2(£[71  - £[SJ)  • 

when  p is  close  to  1,  Kingman  [53]  has  shown  that  the  upper  bound  for  E[W]  is  a good 
approximation  for  £[H''l  itself.  Furthermore,  by  using  the  central  limit,  theorem  on  the  basic 
random  variables  {(/„),  he  has  also  shown  that  under  heavy  traffic,  the  waiting-time  distribution 
under  equilibrium  conditions  is  exponential. 

Lower  bounds  for  E[W]  have  been  derived  by  both  Kingman  [55]  and  Marshall  [74.751. 
Marshall  shows  that 

E[W\  > l, 

where  / is  the  unique  solution  of  the  equation 

x - f [1  - K(u)]du,  (x  > 0), 

**  -jr 

where  PlU  < w]  - K(u).  Kingman’s  alternate  bound  [55]  can  be  given  as 

ew>„£M2L_ 


2(£[71  - £[S|)  ’ 


where  l/+  »=  max  [0,  U ].  Comparing  the  bounds,  Kingsman  points  out  that  Marshall’s  bound 
is  sharper  in  light  traffic  (p  « 1)  whereas  his  bound  is  sharper  in  heavy  traffic.  Nevertheless, 
it  should  be  noted  that  both  lower  bounds  require  the  knowledge  of  the  distribution  of  U, 
whereas  the  Kingman  upper  bound  depends  only  on  the  first  two  moments  of  the  interarrival- 
time and  service-time  distributions.  For  a concise  discussion  of  bounds  and  approximations 
reference  can  be  made  to  Gross  and  Harris  [371,  Chapter  6. 
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Another  approximation  for  E[W]  can  be  obtained  by  writing  ir0  ~ 1 — p and 
E[l  21  ~ E[U 2],  where  p is  the  traffic  intensity  of  the  system.  Then  we  get,  from  (1), 


(3) 


E[W]  = p 


£1T2)  + £[S2]  - 2£,m£lSl 
2(£[T]  - £[S1) 


Comparing  these  approxmations  for  systems  with  one  of  the  interarrival-time  or  service-time 
distribution  exponentials,  Bhat  [7]  has  shown  that  the  simple  approximation  given  in  (3)  is  in 
fact  better  than  the  heavy-traffic  approximation  given  by  (2)  except  when  C,,[S]  » C\.l7l, 
where  C„  stands  for  the  coefficient  of  variation. 


An  additional  effort  in  providing  a better  approximation  for  E[W\  is  that  of  Marchal  [70] , 
who  incorporates  the  coefficient  of  variation  of  the  service  time  distribution  CV(S)  by  suggest- 
ing 


E\W  ] = 


1 + C2  [S] 

Var[r]  + Var[Sj 

p-2  + C,2  [S] 

2(£[r]  - E[S\) 

which  is  identical  with  the  Kingman  heavy-traffic  approximation  when  p = 1.  Marchal  has  also 
provided  an  alternate  lower  bound. 


E[W\  > 


P2  C„2(S)  + p(p  - 2) 

2(1  -p) 


E[T] 


which  incorporates  only  p and  the  coefficient  of  variation  of  the  service-time  distribution  (see 
also  Marchal  (71,72]  and  Kleinrock  [56],  Chapter  2). 


Using  Martingale  theory,  Ross  [92]  has  derived  upper  and  lower  bounds  for  the  mean 
delay  in  the  G/G/l  queue.  Even  though  they  are  somewhat  sharper  than  the  ones  described 
above,  they  are  much  harder  to  evaluate. 

Extending  the  Kingman  upper  bound  (2),  we  may  give  the  following  bounds  for  E[W]  in 
the  multiserver  queue  G/G/s: 

f\w\  < VartT]  + Var(S/s) 

" 2(£[fl  - £[£/*])  ’ 

which  is  essentially  the  G/G/l  result  with  a modified  service  time.  This  result,  originally  sug- 
gested by  Kingman  [54],  has  been  studied  by  Suzuki  and  Yoshida  [98].  A bound  later  sug- 
gested by  Kingman  [55]  has  the  form 

^ sVarlT]  + Var[S]  + (1  - l/s)(£[S])2 
E{W]  * UsElT]  - £[£])  ' 


Bounds  for  some  generalizations  of  the  G/G/l  queue  have  been  derived  by  Marshall  [75]. 
Some  of  the  cases  discussed  by  him  are  queues  with  arrivals  in  batches  of  random  size,  queues 
with  service  in  batches  of  fixed  size,  and  queues  with  added  delay  for  the  first  customer  in  a 
busy  period.  Marshall  and  Wolff  [76]  consider  bounding  the  difference  between  the  mean 
queue  length  found  by  an  arriving  customer  and  the  arbitrary-time  mean  queue  length  in  the 
G/G/l  system.  It  is  also  shown  that,  for  G/G/l,  the  difference  between  the  mean  virtual  wait 
and  the  mean  actual  wait  does  not  exceed  one  half  the  mean  interarrival  time.  Holtzman 
[44,45]  derives  an  upper  bound  for  mean  waiting  time  in  a Poisson  input  single  server  priority 
queue  by  considering  waiting  time  as  composed  of  four  distinct  parts  and  obtaining  an  upper 
bound  for  each  of  them. 
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Heathcote  and  Winer  [41]  take  a somewhat  different  approach  in  deriving  approximations 
for  the  moments  of  waiting  times  in  the  G/G/l  queue.  Using  an  expansion  related  to  the  cen- 
tral limit  theorem,  they  express  E[W„\  — E\W\  as  an  infinite  series.  Now,  knowing  E[W)  one 
could  estimate  E[Wn 1 by  approximating  the  series.  Other  papers  considering  approximations 
and  bounds  for  mean  waiting  time  in  G/G/l  and  G/G/s  queues  or  their  special  cases  are 
Granot  et  al.  [35]  and  Harrison  [40]. 

Approximation  techniques  have  been  used  for  deriving  information  on  other  performance 
measures  as  well.  Rider  [88]  approximates  the  emptiness  probability  to  solve  for  the  average 
queue  size  in  a time-dependent  M/M/1  queue.  Natvig  [80]  approximates  the  transition  proba- 
bility F10  ( r ) of  the  transition  of  the  number  in  the  system  from  1 to  0 in  time  /,  in  a single- 
server Markovian  queue  with  discouragement,  by  simplifying  the  expression  derived  through 
inversion.  Benes  [4]  gives  an  approximation  for  p,„  the  probability  that  an  arriving  customer 
finds  n busy  channels  in  a G/M/s/s  system.  Bene?  [5],  also  provided  an  approximation  for  the 
covariance  function  of  the  number  of  busy  channels  in  an  M/M/s/s  system.  Another  paper 
dealing  with  the  approximations  for  covariance  function  of  the  number  of  busy  channels  in  an 
M/M/s/s  system  is  Descloux  [23].  Approximations  for  Erlang’s  loss  formula  and  its  deriva- 
tives have  been  given  by  Jagerman  [50]  by  truncation  of  a complex  series.  In  these  papers, 
related  mostly  to  teletraffic  theory,  the  technique  used  is  analytical  and  manipulative.  For  other 
papers  belonging  to  this  class,  readers  are  referred  to  Saaty  [93],  Cooper  [20],  Holtzman  [46], 
and  references  cited  by  Holtzman. 

Many  of  the  exact  queueing  results  are  given  as  transform  expressions  that  are  difficult  to 
invert.  Numerical  inversion  of  Laplace  transforms  is  a convenient  technique  when  such  results 
are  needed.  Some  of  the  initial  papers  on  this  technique  are  Gaver  [31],  Weeks  [100],  Dubner 
and  Abate  [24],  Chiu,  Chen,  and  Huang  [18],  and  Stehfest  [96].  Nance,  Bhat,  and  CJaybrook 
[79]  have  applied  the  different  methods  presented  in  the  above  papers  to  invert  the  transform 
of  the  busy-period  distribution  of  an  M/G/l/N  type  queue  occurring  in  a time-sharing  system. 
Abate,  Dubner,  and  Weinberg  [1]  have  applied  the  inversion  method  to  the  transform  of  the 
waiting-time  distribution  for  a mass-storage  device.  It  must  be  pointed  out,  though,  that  in  the 
process  of  numerical  inversion  of  transforms  it  is  desirable  to  experiment  with  more  than  one 
technique,  since  their  performance  is  highly  dependent  on  the  original  function. 

A recent  inversion  technique,  given  by  Knepley  and  Fischer  [57],  makes  the  time  parame- 
ter discrete  and  approximates  a Laplace  transform  by  an  infinite  series.  Recursive  relations 
then  provide  tne  needed  numerical  results.  Al-Khayyal  and  Gross  [2]  approximate  and  bound 
the  root  of  the  functional  equation  associated  with  the  GI/M/s  queue  to  give  bounds  and 
approximations  for  steady-state  measures  of  effectiveness  and  probabilities.  Another  approach 
based  on  transforms  has  been  given  by  Kotiah  [61]  for  Markovian  systems.  (These  procedures 
are  classified  under  numerical  schemes,  since  the  approximation  is  made  on  the  results  of 
analysis.  Nevertheless,  it  is  appropriate  to  mention  that  the  outcome  of  the  procedure  is  an 
approximation  at  the  process  level.) 

Approximation  results  are  also  given  in  the  form  of  limit  and  convergence  theorems.  A 
typical  form  of  a limit  theorem  is  to  describe  the  behavior  of  a certain  process  as  one  of  the 
system  parameters  approaches  a specific  limiting  value.  Convergence  in  queueing  theory  has 
received  some  attention  in  the  last  decade  (see,  for  example,  the  survey  paper  by  Igiehart 
[48]);  however,  not  all  such  theorems  are  meant  to  be  used  as  approximations.  Kollerstrom 
[60]  shows  that  the  waiting  time  for  the  G/G/s  system,  under  some  general  conditions,  con- 
verges to  a negative  exponential  as  p—  1,  and  then  reformulates  the  result  as  an  approximation 
with  error  bounds.  Tomko  [99],  for  p < 1,  gives  an  approximation  to  the  waiting  time  W(,\), 
in  the  queue  M/M/m/N,  in  terms  of  the  waiting  time  W for  M/M/m/°°,  and  he  provides  the 
rate  of  convergence.  For  p — 1,  W{N)  is  shown  to  converge  to  a uniform  distribution  as  the 


JZU  U N.  BHAT,  M.  ) FISCHER  AND  M SHALABY 

capacity  (V— °o,  and  for  p > 1,  W(N)  is  shown  to  converge  to  a normal  distribution.  The 
accuracy  for  the  approximation  of  each  W(N)  by  its  corresponding  asymptotic  distribution  is 
also  estimated.  Kyprianou  [65]  shows  that  the  virtual  waiting  time  conditional  on  its  still  being 
in  the  first  busy  period  in  M/G/l  and  GI/M/1  is  asymptotically,  as  p— '1,  gamma  distributed 
with  two  degrees  of  freedom  and  mean  4m,  where 

= VartTl  + Var[S] 
m 2(1/£[T]  - 1 /E[S])  ‘ 

Schassberger  [95]  approximates  the  G/G/l  queue  by  a sequence  of  queues  in  which  the  interar- 
rival and  service  times  for  the  n"'  system  are  Erlangian  mixtures  which  are  convex  combina- 
tions of  Erlangian  distributions.  He  also  shows  that  the  distribution  function  of  the  virtual 
waiting  time  in  the  n'1'  system  converges  weakly  to  that  of  the  original  system.  Kennedy  [51] 
proves  a similar  but  more  general  result  for  the  single-server  queue. 

In  a way,  the  numerical  analysis  of  queueing  systems  carried  out  in  a series  of  papers  by 
Neuts  and  Neuts  and  Klimko  [81]  can  also  be  identified  as  an  approximating  technique.  It  is  a 
system  type  of  approximation,  in  that  discrete  phase-type  distributions  are  used  for  interarrival 
and  service  times.  In  the  same  spirit,  one  could  include  papers  that  have  appeared  on  other 
numerical  aspects  of  queueing  systems,  such  as  the  solution  of  Chapman-Kolmogorov  equa- 
tions for  birth  and  death  processes.  We  shall  not  elaborate  on  these  topics  here,  since  the 
emphasis  in  this  paper  is  more  toward  identifying  different  aspects  of  approximations. 

VALIDATION  OF  APPROXIMATIONS 

Validation  is  an  integral  part  of  an  approximation  procedure.  It  is  needed  to  support  the 
applicability  of  the  technique  and  the  reliability  of  results.  An  applied  scientist  has  to  constantly 
evaluate  the  trade-off  between  the  ease  of  application  of  a particular  technique  and  the  accuracy 
of  the  ensuing  results.  Therefore,  we  expect  the  validation  procedure  to  relate  in  some  way 
and  provide  a comparison  between  approximate  and  exact  results.  Generally,  validation  of 
approximations  can  be  achieved  through  error  analysis,  experimentation,  and  simulation.  The 
relative  merits  of  these  procedures  are  discussed  in  the  following  paragraphs. 

In  error  analysis,  the  deviation  from  an  exact  result  is  estimated  as  a function  of  the  sys- 
tem parameters.  For  example,  if  we  approximate  by  truncating  a series,  any  bound  on  the 
remainder  of  the  series  will  bound  the  error.  One  of  the  error-analysis  procedures  is  to  show 
that  the  error  converges  to  zero  as  one  or  more  of  the  parameters  take  a limiting  value  (see,  for 
example,  Natvig  [80]).  If  the  result  is  of  a limiting  nature,  then  the  rate  of  convergence  may 
help  provide  an  error  estimate  (Kollerstrom  [60],  Tomko  [99]).  For  two-sided-inequality 
results  the  error  is  bounded  by  the  length  of  the  interval;  however,  one  needs  to  compare  the 
bounds  with  some  exact  results  as  well  (Bloomfield  and  Cox  [12],  Marshall  [75]).  Apart  from 
inequalities,  numerical  point  approximation  is  the  only  approach  through  which  error  estimates 
are  obtained. 

Experimentation  is  the  most  common  validation  technique  for  approximations.  The 
essential  feature  of  this  procedure  is  to  compare  the  approximated  and  the  exact  results  for 
some  special  cases;  if  the  comparison  is  favorable,  similar  performance  is  expected,  in  general. 
Absence  of  support  for  this  basis  requires  careful  and  exhaustive  experimentation  covering  a 
wider  range  of  parameters.  Clearly,  this  approach  can  be  used  for  any  type  of  approximation. 
For  example,  it  is  used  in  Benes  [4],  Heathcote  and  Winer  [41],  Holtzman  [44],  and  Rider  [88] 
to  validate  numerical  approximations.  Avi-ltzhak  and  Heyman  [3],  Bhat  and  Fischer  [8],  Kuc- 
zura  [64],  Leibowitz  [67],  and  Marchal  and  Harris  [73]  have  used  this  method  in  the  context  of 
system  approximations.  Gaver  and  Shedler  [33],  Heyman  [43],  and  Reiser  and  Kobayashi  [87] 
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have  used  it  to  validate  diffusion-approximation  techniques.  The  main  disadvantage  in  the  pro- 
cedure, though,  is  the  lack  of  certainty  that  the  conclusions  drawn  from  experimentation  can  be 
extrapolated  into  more  general  settings. 

Simulation  of  stochastic  system  has  become  popular,  due  to  its  wide  applicability,  close- 
ness to  reality,  and  the  ability  to  use  statistical  analysis  techniques.  It  is  the  last  property  that 
makes  simulation  a seemingly  dependable  and  appealing  validation  technique.  As  can  be  seen 
from  Fishman  [30],  considerable  work  has  been  done  on  the  statistical  aspects  of  simulations. 
But  a word  of  caution  is  that  the  analysis  is  all  too  often  messy  and  heavily  dependent  on  fac- 
tors such  as  sample  size.  The  general  approach  is  to  generate  samples  of  the  studied  process 
and  define  estimates  for  the  required  measures  of  performance.  If  the  process  is  of  the  regen- 
erative type,  then  the  classical  statistical  techniques  can  be  used  to  obtain  confidence  intervals 
and  percentiles  (see,  for  example,  Fishman  [29],  Iglehart  [49],  and  Lavenberg  and  Slutz  [66]). 
Otherwise,  one  has  to  deal  with  the  usual  problems  arising  in  simulation,  such  as  dependent 
samples,  effect  of  initial  state,  and  transient  behavior.  In  either  case  the  simulation  model 
needs  validation,  and  this  is  usually  done  through  experimentation  (see,  Rosenshine  and  Chan- 
dra [91]).  The  use  of  simulation  as  a validation  technique  is  common  under  system  approxima- 
tions (Chandy,  Herzog,  and  Woo  [16,1^],  Halfin  [39],  Moore  [78],  and  Sauer  and  Chandy  [94]) 
and  process  approximations  (Halachmi  and  Franta  [38],  Heyman  [43],  Kobayashi  [58,59],  and 
Reiser  and  Kobayashi  [87].  For  the  validation  of  numerical  approximations,  even  though  error 
analysis  is  easier,  simulation  may  be  used  (see  Descloux  [23]).  However,  most  of  these 
authors  have  satisfied  themselves  by  the  relative  size  of  the  percentage  difference  between  the 
simulated  and  approximate  results.  Very  few  of  them  have  resorted  to  a statistical  analysis  of 
simulated  results  and  provide  information  such  as  confidence  bounds  on  their  estimates.  When 
one  uses  simulation  for  the  validation  of  approximations,  it  is  desirable  to  state  the  accuracy  of 
the  simulated  results  as  well. 

As  discussed  above,  validation  takes  different  forms  that  vary  in  their  usefulness.  We 
consider  error  analysis  as  the  most  reliable  procedure.  However,  it  is  difficult  to  implement 
under  system-approximation  and  diffusion-approximation  techniques.  Inequalities  may  not 
need  validation  if  they  are  tight  enough.  Nevertheless,  it  should  be  noted  that  inequalities  that 
are  tight  are  hard  to  compute,  and  those  that  are  simple  to  compute  are  not  tight.  Thus,  a sen- 
sitivity analysis  of  inequalities  over  the  rest  of  the  parameters  may  be  recommended  (Bhat  [7]). 
Experimentation  and  simulation  are  the  more-common  forms  of  validation  techniques,  but, 
while  we  use  them,  their  limitations  should  be  clearly  understood. 

FUTURE  PROSPECTS 

Given  above  is  a broad  picture  of  approximation  techniques  used  in  queueing  theory. 
Existing  work  in  the  queueing  literature  has  been  included  in  one  or  the  other  category  of 
approximation,  considering  the  main  thrust  of  the  paper.  It  must  be  noted,  however,  that  many 
times  a combination  of  more  than  one  technique  may  be  needed  for  a complete  solution. 

The  emergence  of  approximate  results  is  directly  related  to  the  applicability  of  systems. 
Furthermore,  except  for  the  well-known  approximations  for  the  mean  waiting  time  in  G/G/l 
and  related  systems,  most  of  the  simple  and  applicable  results  occur  predominantly  in  applica- 
tion areas  of  queueing  theory,  such  as  telephone  traffic  and  computer  systems.  There  is  a 
significant  factor  in  this  phenomenon  to  be  noted  by  a researcher.  Since  approximate  results 
are  obtained  for  direct  use  in  real-world  problems,  they  should  be  easily  computable.  There- 
fore, it  does  not  make  sense,  except  as  an  intellectual  exercise  and  a theoretical  piece  of 
research,  to  provide  a better  approximation  which  is  much  harder  to  compute  than  an  available 
simpler  approximation.  Thus,  all  applicable  approximate  results  need  to  be  examined  from  an 
effort-benefit  view  point. 
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As  indicated  earlier,  validation  of  approximate  results  has  attracted  considerable  attention, 
specifically  in  the  application  areas.  Nevertheless,  not  enough  attention  seems  to  have  been 
paid  to  the  quality  of  the  validation  technique  itself.  In  the  case  of  experimentation,  more  sen- 
sitivity analysis  is  needed.  Wider  use  of  statistical  techniques  related  to  point  and  interval  esti- 
mation should  be  made  when  simulation  is  preferred. 

Queueing-theory  researchers  have  been  criticized  for  studying  systems  that  are  not 
relevant  to  the  real  world.  However,  it  seems  to  us  that  this  criticism  is  largely  due  to  the  com- 
plexity of  available  results  in  the  literature  rather  than  due  to  the  systems  themselves.  If  one 
looks  at  some  of  the  applied  areas  of  queueing,  one  finds  more  complex  systems  than  those  in 
the  general  operations-research  and  applied-probability  literature.  The  distinction  is  in  the 
nature  of  analysis.  The  results  found  in  the  applied-area  literature  are  applicable,  though 
approximate.  A large  percentage  of  results  found  in  the  general  literature  is  less  useful,  though 
.rigorous.  Therefore,  if  we  want  to  keep  queueing  theory  as  an  integral  part  of  operations 
research  and  as  a problem-solving  tool  in  the  general  area  of  applied  probability  and  mathemat- 
ics, approximation  techniques  should  be  put  to  increasing  use  whenever  necessary.  The  trend 
during  the  past  decade  is  in  this  direction,  and  there  is  every  reason  to  believe  that  this  trend  is 
going  to  continue  further  in  the  coming  years,  bringing  more  reliability  and  applicability  for  the 
techniques  used. 
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ABSTRACT 

Lei  ( Y,  AT  | . ....  XK>  be  a random  vector  distributed  according  to  a mul- 
tivariate normal  distribution, where  X\ X%  are  considered  as  predictor 

variables  and  y is  the  predictand  Let  r,  and  R,  denote  the  population  and  sam- 
ple correlation  coefficients,  respectively,  between  Y and  Xr  The  population 
correlation  coefficient  r,  is  a measure  of  the  predictive  power  of  Xr  The  author 

has  derived  the  joint  distribution  of  ( R % and  its  asymptotic  property. 

The  given  result  is  useful  in  the  problem  of  selecting  the  most  important  pred- 
ictor variable  corresponding  to  the  largest  absolute  value  of  r, . 

1.  INTRODUCTION 

The  problem  of  selecting  a variable  or  several  variables  from  a set  of  predictor  variables 
[XJ  occurs  frequently  in  the  design  of  experiments.  The  correlation  between  a predictor  vari- 
able X,  and  the  predictand  Y measures  the  "leverage"  of  X,  upon  Y.  If  X,  and  Tare  jointly  dis- 
tributed according  to  the  standard  bivariate  normal  distribution,  with  correlation  coefficient  r,, 
then  the  conditional  distribution  of  Tgiven  X,  is  normal  N(r,X,,\  - r,2).  The  larger  the  abso- 
lute value  of  r„  the  smaller  is  the  variance  of  the  conditional  distribution,  and  therefore  the 
higher  is  the  predictive  power  of  X,.  Thus,  the  predictor  variable  corresponding  to  the  largest 
value  of  r,  may  be  considered  as  the  most  important  (best)  predictor  variable. 


The  problem  of  selecting  one  or  more  of  the  predictor  variables  which  have  larger  correla- 
tions with  the  predictand  than  the  rest  of  the  variables  arises  in  the  test  of  accuracy  of  a weapon 
system.  The  accuracy  may  be  described  by  the  radial  distance  between  the  target  and  the  point 
of  impact  of  a projectile  released  by  the  weapon.  There  are  a number  of  contributory  factors  in 
missing  the  target.  Let  Tj  X2  ...  denote  the  variables  measuring  the  effects  of  the  contribu- 
tory factors.  These  variables  are  positively  correlated  with  Y and  among  themselves.  If  the 
correlation  between  T and  Xh  say,  is  much  larger  than  the  correlations  between  Land  X2,  etc., 
then  the  factor  associated  with  X t may  be  considered  as  a major  contributory  factor  in  missing 
the  target  which  should  be  looked  into  for  better  control  of  the  projectile.  Generally,  it  is 
expensive  to  measure  the  variables,  since  the  measurements  invole  the  destruction  of  the  pro- 
jectile. Therefore,  it  is  desirable  to  estimate  the  correlations  between  the  variables  from  a sam- 
ple of  observations.  The  results  of  this  paper,  which  deals  with  the  joint  distribution  of  the 
sample  correlation  coefficients,  would  be  useful  in  screening  a set  of  predictor  variables  for  the 
selection  of  one  or  more  of  them  on  the  basis  of  their  correlations  with  the  predictand. 


'The  author’s  work  was  supported  by  the  Office  of  Naval  Research  under  Contract  N00014-75-0451. 
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The  problem  of  selecting  the  predictor  variable  associated  with  the  largest  correlation  with 
the  predictand  has  been  considered  recently  by  Ramberg  [3].  Rizvi  and  Solomon  [4]  and  Alam, 
Rizvi,  and  Solomon  [1]  have  also  considered  the  problem  of  selecting,  from  p > 2 multivariate 
normal  populations,  the  population  with  the  largest  multiple  correlation  between  a single  vari- 
ate, classified  as  the  predictand,  and  the  remaining  variates. 


Let  the  random  vector  ( Y,  X\.  ...  , XK)  be  distributed  according  to  a multivariate  normal 
distribution.  Suppose  that  a sample  of  n observations  is  taken  from  the  given  distribution.  Let 
r,  and  R,  denote  the  population  and  sample  correlation  coefficients  between  Y and  Xn  respec- 
tively. Let  r,*-  r,(l  - r,2) -l/2  and  R,'  — R,(l  - R,2)  ~,/2.  In  the  following  section  we  derive  the 
distribution  of  R * — (R{,  ...  , /?*).  The  distribution  of  R*  is  expressed  in  terms  of  the  joint 
distribution  of  three  independent  random  variables.  The  asymptotic  distribution  of  R * for  large 
n is  also  given. 

2.  DISTRIBUTION  of  R* 


d 

Let  ~ mean  "distributed  as".  Without  loss  of  generality  we  can  assume  that  the  variables 
Y,  Xx,  ...  , XK  are  standardized,  that  is,  they  are  distributed  with  mean  0 and  variance  1.  Let 
r,j  denote  the  correlation  coefficient  between  X,  and  Xt  , and  let  Z = (rfJ)  and  Z — (rj).  Let 
Y„  Xu.  ...XKl)  denote  the  r-th  observation  in  the  sample,  and  let 

X,--n  ±X,  Y=  1 t Y„  S2  — t(y,-  ?)2- 

n cl  n i-i  /-i 


Then 

(2.1) 

and 


Z (Y,-  Y)X„ 


r-\ 


(2.2)  V-  Z(Xir-X,)2-  V2. 

r-l 

d 

From  the  theory  of  linear  regression  analysis  it  is  seen  that  W,  = (1  - r2)  chi-square 

with  n-2  degrees  of  freedom,  independent  of  V,  and  Y = (K,,  ....  Y„)\  V,  = N(r,S,  1 — 
r2) , and  cov  ( Vn  V,)  — rH  — r,rh  conditionally  given  Y.  Let  Xu  *=  ru  - r.r,  and  O — (A„).  It  is 
also  seen  that  Wi  can  be  represented  as  the  sum  of  squares  of  (n  - 2)  orthogonal  linear  func- 
tions of  Xu,  ....  X,„.  That  is, 

d n-2 

(2.3)  W,  = £ Z2 

t-i 


where  Z,  - (Zj„  ....  Zk,Y  are  identically  and  independently  distributed  as  NiO,  ft), 
independent  of  Vx,  ... , VK  and  S. 


Let  T - ( 7*| , ...  , TkY  be  a random  vector  distributed  as  NiO,  ft),  independent  of  S 
and  W- OF, WK)’.  Then 

(2.4)  ft  - V,  (W,)-'** 

+ n s)  W-"2. 


Therefore, 
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THEOREM  2.1:  The  joint  distribution  of  the  sample  correlation  coefficients  between  the 
predictand  and  the  predictor  variables  of  a multivariate  normal  distribution  is  given  by  (2.4), 

rf  d 

where  T =as  N(0,  0),  S1  = x2_(,  and  the  distribution  of  W is  given  by  (2.3).  Moreover,  S,  T 
and  W are  jointly  independent. 

For  large  n,  W is  asymptotically  distributed  as  Nlin  - 2)f,  2 (n  - 2)ftJ,  by  Theorem 
4.2.4  of  Anderson  12],  where  f - (1  - rj1,  ....  1 - r#  and  ft  - (X,J).  Therefore, 

^ COROLLARY  ^2.1:  The  asymptotic  distribution  of  R*  is  given  by  (2.4),  where 

T = N(0.  ft),  S1  x}-u  w = (n  - 2)/,  2 (n  - 2)  ft),  and  S,  T,  and  W are  jointly 
independent. 


The  following  corollary  gives  the  asymptotic  distribution  of  ~Jn  (R*-r*),  which  is 
derived  from  (2.4)  but  follows  also  from  the  central  limit  theorem  or  Theorem  4.2.4  of  Ander- 


Let  y,j  — (rlf  — rjt)  (1  - r*)~ui  (1  - r})~'n  and  T - (y2).  From  (2.4)  we  have  for 
large  n 

(2.5)  o - n i - - 1 + 

« 

- 7)(1  - r,2)-'/2  + (A  - Bj)  + Op(rT1'2). 

d d 

where  A ~ N(0,  1),  B — (Bx,  ...  . £*)'  ~ N(0,  D.  Moreover  T,  A and  B are  jointly 
independent.  Therefore,  VrT  (R*  - r*)  is  asymptotically  distributed  as  7V(0,  C),  where 

(2.6)  Q-l  + r'2 


Qi~y,i  + J K r/  (1  + yfj). 


Therefore 


COROLLARY  2.2:  For  large  n,  -Jn  (R*  - r*)  is  asymptotically  distributed  as  Af(0,  C), 
where  Cis  given  by  (2.6). 

It  is  interesting  to  consider  the  following  special  cases:  ( 1 ) r,  - 0,  rtJ  - 0,  / ^ j for  all  i 

and  j ; that  is,  the  variables  Y,  Xx,  ...  , XK  are  jointly  independent.  We  have  C — 1 and 

d 

yfn  (R*  - r*)  = N(0,  /),  asymptotically.  (2)  r,  - 0,  ru  - p,  / ^ j for  all  / and  J\  that  is, 

the  predictor  variables  Xx XK  are  equi-correlated  and  independent  of  Y.  We  have 

C7„  — 1,  C,j  - p,  / ^ j.  (3)  r,  — p,  ru  - 0,  / ^ j for  all  i and  j ; that  is,  the  predictor  variables 
are  jointly  independent  and  equi-correlated  with  Y.  We  have 

C„-(l  - p2)'1 


r _ p2  (2p2  - 1) 

" 2(1  - p2)3  ‘ 


Consider  the  problem  of  selecting  the  best  predictor  variable.  A standard  procedure  is  to 
select  the  variable  from  the  predictor  variables  corresponding  to  the  largest  value  of  the  squared 
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correlation  coefficients  R{.  ....  Rj<  or,  equivalently,  R [2,  ...  , Rp.  By  Corollary  2.2  the  pro- 
bability of  a correct  selection  can  be  derived  for  large  n from  the  multivariate  normal  distribu- 
tion function.  In  special  case  (1)  we  have  that  n max  (R{7,  ....  R*2)  is  distributed  as  the 
largest  order  statistic  in  a sample  of  K observation  from  \ 7 — chi-square  with  1 degree  of  free- 
dom. This  result  can  be  used  also  to  test  the  significance  of  the  correlation  between  the 
selected  predictor  variable  and  the  predictand.  Similar  results  are  obtained  for  cases  (2)  and  (3). 

Let  r°  be  a given  value  of  r*.  From  Corollary  2.2  we  have  that  n (R  * — r T 
C~'  (R*  - r0)  is  asymptotically  distributed  as  xls  - noncentral  chi-square  with  K degrees  of 
freedom  and  noncentrality  parameter  8 — n(t*  — rT  — t°).  Let  C “ C(R*.  (/?,,)) 

denote  the  estimate  of  C where  R:j  are  the  sample  correlation  coefficients  between  X,  and  Xr 
C converges  in  probability  to  C as  n -*  oo.  Therefore,  the  statistic  8 - n(R*  - rT 
C_1(r*  - can  be  used  to  test  the  hypothesis  that  r*  - r°. 
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ABSTRACT 

The  paper  proposes  an  algorithm  for  the  determination  of  the  solution  of 
the  activities  to  be  shortened  and  the  amount  by  which  they  are  to  be  shor- 
tened in  order  to  minimize  the  total  cost  of  project  completion.  This  cost  in- 
volves a linear  penally  for  tardienss  of  a set  of  key  events  and  a linear  cost  of 
activity  compression  from  its  normal  duration.  The  procedure  is  a generaliza- 
tion of  the  work  of  Fulkerson. 


INTRODUCTION 

This  paper  deals  with  the  problem  of  optimal  project  "compression"— or  early  finish- 
assuming  linear  costs  of  shortening  individual  activities  as  well  as  linear  penalties  for  tardiness 
of  a subset  of  events.  It  proposes  a model  and  an  algorithm  for  its  solution. 

Assumed  given  is  the  project  network  G - (N,A),  where  N is  the  set  of  nodes  (or 
events),  N = [ 1,  2,  ....  «},  and  A is  the  set  of  arrows  (or  activities).  The  network  is  acyclic, 
and  we  assume  that  each  arrow  leads  from  a small-numbered  node  to  a higher-numbered  one. 
For  more  background  on  such  network  representation  of  projects  and  the  relevant  terminology, 
see  Ref.  [2],  Chapters  1 and  2.  An  activity  may  be  designated  either  by  its  end  nodes  / and  j or 
by  its  generic  designation  e € A.  Its  duration  is  denoted  by  yf,  where  0<  le  ^ ye  ^ ue  < +°°. 
It  is  assumed  that  ut  represents  the  "normal"  duration  of  the  activity,  that  is,  its  lowest-cost 
duration  before  any  shortening  is  undertaken.  As  yt  is  shortened  away  from  ue  a cost  is  accu- 
mulated at  a rate  ae  > 0;  that  is,  the  cost  of  activity  e when  it  is  accomplished  in  duration  y,  is 
given  by 

ce  - be  -aeye,  for  /,,  < ye  < ue  and  ae,  be,  ce  > 0, 

where  be  is  the  intercept  of  the  line  c,  with  the  cost  axis.  The  impetus  to  shorten  any  activity 
(and  thus  incur  additional  costs)  stems  form  the  fact  that  a subset  K (£  N ) of  the  nodes,  the 
so-called  key  events,  have  specified  due  dates  [dk\  A 6 AT)  and  penalties  pk  > 0 incurred  per 
unit  time  of  tardiness.  We  presume  that  the  last  node  n carries  a due  date;  otherwise  we  ignore 
the  subnetwork  after  the  largest  due-dated  node.  Let  tj  denote  the  time  of  realization  of  node 
J € N.  Evidently,  [tj]  are  dependent  on  the  activity  durations.  If  we  put  y,  — ut  for  all  e 6 A, 
and  it  turns  out  that  all  realization  times  of  all  key  events  are  no  larger  than  their  respective 
due  dates,  then  that  must  be  the  cheapest  possible  realization  of  the  project. 

•This  research  was  partially  supported  by  ARO  Contract  DAAG29-76-G-0204. 
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The  problem  of  project  compression  arises  when  some,  or  all,  of  the  key  events  are  tardy. 
Then  it  is  desired  to  determine  the  subsets  of  activities  whose  duration  are  to  be  shortened,  and 
the  amount  of  that  shortening,  in  order  to  incur  the  smallest  total  cost  (—  cost  of  shortening 
plus  cost  of  tardiness). . 

Mathematically,  the  problem  may  be  stated  as 
(1.1)  Minimize  z - £ c(J  + £ P*v* 

( ij ) kiK 

- £ (b,j  - a,jy,j)  + £ pkvk 

( ij ) * € AT 


subject  to 


Dual 


Kl  — 


Variables 


(1.2)  t,  - tj  + y,j  < 0, 

all  (Of)  € A ; 

fu 

(1.3)  — 1\  + — v*  ^ dk 

, all  A € K, 

(1.4)  yu  < u,j, 

all  (ij)  € A \ 

SiJ 

(1.5)  -y,j  < -lu, 

all  (ij)  6 A; 

h’j 

The  first  set  of  constraints  of  (1.2)  consists  of  the  standard  "earliest  realization  time"  con- 
straints, which  express  the  condition  that  node  j cannot  be  realized  except  after  all  (immedi- 
ately) preceding  nodes  have  been  realized  and  all  connecting  activities  have  been  completed. 
The  second  set  of  contraints  of  (1.3)  is  derived  from  the  fact  that  (tk  - r ,)  - dk  may  be  a posi- 
tive number  (betraying  a tardy  event)  or  a negative  number  (betraying  an  early  event),  hence  it 
can  be  written  as  tk  — /,  — dk  — vk  — wk,  where  vk  and  wk  are  > 0.  Rearranging  the  variables 
and  dropping  the  slack  variable  wk,  we  get  (1.3).  Note  that  the  variable  v*  > 0 measures  the 
tardiness  of  node  k € K,  hence  it  is  "costed"  at  the  rate  pk  in  (1.1). 

The  problem  specified  by  (1)  is  an  LP  with  3A  + K constraints  in  A + N original  vari- 
ables. (Note  that  we  are  using  the  same  symbol  to  denote  the  set  and  its  rank.)  A frontal 
attack  on  this  LP  using  regular  simplex  iterations  would  miss  capitalizing  on  its  special  struc- 
ture. Such  capitalization  is  the  subject  of  this  paper. 

For  the  moment  it  is  appropriate  to  remark  that  a simpler  version  of  the  LP  of  (1),  in 
which  no  due  dates  were  specified  (whence  the  constraints  (1.3)  were  absent),  was  treated  by 
Fulkerson  [3].  Our  approach  relies  heavily  on  tha'  ievelopment,  and  may  be  viewed  as  a gen- 
eralization of  it.  See  also  Ref.  IS],  pp.  163-169,  for  an  out-of-kilter  algorithm  to  the  solution  of 
that  simpler  version. 

THEORY  OF  APPROACH 

We  rewrite  the  objective  of  (1.1)  as 
(2)  Maximize  £ - £ P*v*. 

{ij)  ktK 

in  which  we  ignore  the  constant  term  £ b,f  and  reverse  signs.  Let  u **.  g,j,  and  h,j  be  the 

(i/» 

dual  variables  corresponding  to  constraints  (1.2)  to  (l.S).  Utilizing  the  objective  in  (2),  the 
dual  LP  may  be  stated  as 

(3.1)  Minimize  £«//»</  - £ (</*</  + £ <**** 

<#/)  iij)  ktK 


i 

\ 


i 

i 
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subject  to 
(3-2) 

JiA(  1)  * € AT 

where  -4(1)  is  the  set  of  nodes  immediately  following  node  1 and  connected  to  it, 

(3.3)  jx*  if  ; — k, 

~ 7L  fij+  X fji  “jo  if  i 4 K 1 

J€A(i)  j€B(i)  1 *' 

where  B(i ) is  the  set  of  nodes  immediately  preceding  node  / and  connected  to  it, 

(3.4)  fu  + g,j  - h,j  - a,j,  all  (ij)  € A, 

(3.5)  X*  < pk,  all  k € K, 

(3.6)  fij,  gij,  hjj  > 0 for  all  (ij)  € A,  and  X*  > 0 for  all  k € K. 

Equality  appears  in  (3.2)  to  (3.4)  because  the  (primal)  /,  variables  were  not  constrained  in  sign. 
Remarking  that  g0  and  h,j  cannot  simultaneously  be  positive  in  an  optimal  solution,  since  uu  is 
assumed  larger  than  ltj  (the  trivial  case  in  which  lu  — uu  fixes  the  magnitude  of  ytJ  at  their  com- 
mon value,  and  it  is  no  longer  a variable),  we  express  these  two  variables  in  terms  of  ftj  as  fol- 
lows 


gu  - max(0,  a,j  - f,j), 
h,,  - max(0,  fu  - au). 

To  eliminate  the  "max"  operator  in  these  two  expressions,  divide  the  total  "flow"  fu  into  two 
parts,  f)  and  fj.  such  that  f0  - fj  + fj,  0 < fj  < a0,  and  fj  - fu  - au  > 0.  Whence 
g,i  — a,j  - fj  > 0 and  htj  - fj.  Substituting  these  new  relations  into  (3)  and  reversing  the 
sign  of  the  objective  function,  we  obtain  finally  the  dual  LP, 

(4.1)  Maximize  £ uijfij  + L :tjfu  ~ X 

<(/)  (/»  k(K 

subject  to 


(4.2) 

(4.3) 


(4.4) 

(4.5) 


I (y^+^-i4 

y€-4(l)  k 


- I (/,}  + /,])  + I (/>  + fj) 

JkA(i)  JkB(i) 


\k  if  / — k € K, 

0 if  it  K,  i pi  1, 


0 < f]  < a,7, 

0 < fij.  with  fij  - 0 if  fj  < a,j  or  fj  - aij  but  yu  > lu, 
0 < X*  ^ pk,  for  all  k € K. 


Assume  hereafter  that  tx  — 0;  whence  constraints  (1.3)  would  now  read  as  follows: 

dk.  k € K. 

Complementary  slackness  conditions  on  the  optimal  solution  of  the  primal  and  dual  LPs 
of  (1)  and  (3)  reveal  that  if  tk  ^ dk,  k € K,  then  X*  may  be  > 0,  while  if  < dk , then 
X*  - 0.  Define  sj  - ry  - t,  - u0  and  sj  - tj  — r,  - /,,,  which  represent  the  slack  in  the  times 
of  realization  constraints  of  (1.2)  corresponding  to  the  upper  and  lower  bounds  on  the  value  of 
the  duration  yih  respectively. 

The  proposed  iterative  procedure  rests  on  the  fact  that  an  intermediate  step  corresponds 
to  a particular  primal  feasible  solution,  and  that  cost  minimization  is  equivalent  to  flow  maximi- 
zation in  a specific  subnetwork,  namely,  the  so-called  critical  subnetwork.  Demonstrating  this 


f 
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equivalence  also  gives  the  clue  to  the  general  procedure  to  be  followed.  The  arguments  are 
typical  primal-dual  arguments  throughout. 

An  initial  feasible  solution  to  the  primal  LP  of  (1)  is  easily  obtained  by  setting  y0  — u0 
for  all  (ij)  € /4,  r,  - 0,  and  /,  - max  (f,  + u„).  There  shall  exist  at  least  one  "critical  path"  to 

itB(j) 

each  node  k 6 K,  and  the  collection  of  the  arcs  that  define  these  paths  constitutes  the  critical 
subnetwork , denoted  by  P.  For  each  arc  in  P we  have  s,J  —0;  consequently,  the  dual  variables 
and  g,j  may_have  values  > 0,  for  all  (ij)  € P,  and  the  dual  variables  {X*}  may  have  values 
> 0 for  k 6 K,  where  K £ K is  the  subset  of  those  A:  € K for  which  tk  > dk.  (Note  that, 
since  we  assumed  u,j  > l0  \f(ij).  s,j  > 0 — h,j  -■  0;  hence  by  definition  f]  - 0.)  The  objec- 
tive function  of  the  critical  subnetwork  Pis 

(5)  Maximize  £ M.y/J  ~ Z </kXk. 

UjHP  kik 


Consider  node  k € K,  and  let  the  paths  in  P leading  to  it  be  designated  by 

nq(k),  q - 1,  2 Let  /) (k)  be  the  portion  of  flow  in  arc  (ij)  € P that  goes  to  node  k. 

Then  the  objective  function  (5)  may  be  rewritten  as 

ZjZ  Z UijfiM)  - dk\k 

*6X1  Q (ijltirq(k) 

By  conservation  of  flow  along  the  path  irq(k),  it  must  be  true  that  the  portion  of  f,lj(k)  des- 
tined for  key  event  k is  constant  along  the  path,  say  f'(q.k).  Furthermore,  £ u0  - tk, 

Oj)Cvq(k) 

by  the  definition  of  the  critical  path  to  node  k.  Finally,  £ fl(q,k)  -Xk,  by  (3.3).  All  of 


which  reduces  the  objective  in  (5)  to 
K , finally  reduces  to 


J)  X*(f*  - dk),  which,  since  vk 

k(K 


tk  - dk  > 0 for  k € 


(6) 


Maximize  £ Xkvk. 

ktK 


For  any  given  durations  [y,y},  Uie  critical  subnetwork  is  fixed  and  vk  is  a constant  that 
measures  the  tardiness  of  node  k 6 K.  Consequently,  we  can  maximize  (6)  by  maximizing  the 
values  of  Xk,  which,  in  turn,  implies  our  maximizing  the  flows  in  P.  We  achieve  this  [4]  by 
selecting  the  most  tardy  event(s)  and  maximizing  the  flow  to  it,  while  respecting  constraints 
(3.3)  and  (3.5),  then  the  second  most  tardy  event (s),  and  so  forth  until  all  nodes  in  K have 
been  considered.  This  completes  one  cycle  of  iteration,  since  now  the  optimum  of  the  res- 
tricted dual  LP  of  (3)  is  in  hand. 

Focus  is  now  shifted  to  the  primal  LP  of  (1),  where  the  durations  of  activities  are  shor- 
tened in  such  a way  as  to  maintain  the  complementary  slackness  conditions  for  optimality.  An 
activity  (ij)  € A may  be  shortened  if  the  following  two  conditions  are  satisfied  simultaneously: 


(i)  ft)  - 0^  (no  activity  is  shortened  if  its  flow  /,)  is  < atJ) , 

(ii)  if  ( ij ) € irq(k)  for  some  k with  tk  - dk,  then  \k  - 0 (no  activity  is  shortened  if  it  lies 
on  a CP  to  some  key  event  that  is  on  time  but  whose  associated  X is  > 0). 

An  activity  (ij0)  satisfying  these  two  conditions  is  called  an  eligible  activity,  which  may  be  shor- 
tened until  one  of  the  following  eventualities  occurs:  (.1)  Some  s,J  — 0 for  (ij)  € A - P, 
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whence  the  critical  subnetwork  /*  will  be  augmented  by  a new  path  containing  activity  (</);  (2) 
*?'t0  “ 0;  i.e.,  the^activity  has  been  shortened  to  its  lower  bound  (3)  the  due  date  dm  for 
some  node  m € K is  met;  i.e.,  tm  — dm  for  some  m € K.  Such  compression  is  carried  out  for 
all  eligible  activities  in  P.  When  this  phase  is  completed,  at  least  one  more  slack  variable  jj,  s,j 
or  vk  is  driven  to  zero.  In  the  case  of  some  sj  or  s,j  becoming  equal  to  zero,  the  corresponding 
dual  activity  (fj  or  /],  respectively)  is  added  to  the  restricted  dual  problem,  implying  the  aug- 
mentation of  the  restricted  dual  LP  by  that  activity.  Optimization  of  the  newly  augmented  res- 
tricted dual  proceeds  as  described  above.  In  the  case  of  some  v*  being  reduced  to  zero,  an 
intermediate  step  is  needed  to  ensure  that  its  kk  is  also  reduced  to  zero  if  at  all  possible.  This 
is  accomplished  by  rerouting  the  flow  into  node  k to  other  nodes,  as  explained  in  the  algorithm 
below.  The  termination  of  the  process  is  realized  when,  for  all  k e K,  either  of  the  following 
two  conditions  is  satisfied: 


(i)  tk  ^ dk, 

(ii)  tk  > dk  and  \k  - pk. 

At  that  point  the  optimum  is  in  hand. 

ALGORITHM:  The  statement  of  the  algorithm  will  be  accompanied  by  some  explanatory 
remarks  to  render  it  more  accessible.  (See  also  the  flow  chart.  Figure  1.)  Recall  that  A 
represents  the  set  of  arcs,  B(J)  the  set  of  nodes  immediately  before  node  j and  connected  to  it 
with  one  arc,  K the  set  of  tardy  due-dated  key  events,  and  P the  subnetwork  composed  of  all 
arcs  on  the  critical  paths  to  the  nodes  in  the  set  K,  the  so-called  critical  subnetwork. 

STEP  0.  Initialization:  Set  all  y„  - uu.  /,]  - 0 - /j;  V (//)  6 A \ f,  - 0,  X*  - 0,  V k € 
K.  Determine  all  node  realization  times  r,  - max  (/,  + u„)  j - 2,  3,  . . . , n and  (//')  € A 

i € B(j) 

This  step  determines  the  normal  times  of  realization  of  the  nodes  of  the  network  prior  to 
any  compression. 

STEP  1.  Determine  the  Critical  Subnetwork^  P.  Determine  v*  - max(0,  tk  - dk)  for  all  k € 
K.  Let  K denote  the  set  of  tardy  nodes,  K — {k:  vk  > 0},  and  denote  the  difference  set 
K - K by _K  °;  i.e.,  K {A:  v*  - 0).  If  fC  — K,  or  if  at  any  stage  of  iteration  kk-  pk  for 
each  k € K,  stop;  the  optimum  is  in  hand.  Otherwise,  let  M denote  the  set  of  tardy  nodes  that 
have  been  examined.  At  the  outset,  M * (0),  the  null  set.  Node  k will  be  added  to  the  set  M 
in  Step  2 if  that  node  is  the  currently  most  tardy  one.  Construct  the  critical  subnetwork  P as 
the  union  of  all  arcs  leading  to  nodes  in  K. 


: 

( 

I 

s 


STEP  2.  Determine  the  Most  Tardy  Key  Event  : Let  node  k be  the  node  such  that 
vk  — max  vm,  m € K - M.  If  A is  not  unique,  choose  any  one  arbitrarily.  Add  k to  the  subset 
M. 

This  step  identifies  the  most  tardy  key  event  not  yet  considered.  The  set  M accumulates 
the  tardy  events  that  have  been  considered. 

STEP  3.  Maximize  Flow  to  Most  Tardy  Node.  The  rationale  behind  the  approach  of  aug- 
menting the  flow  is  that  we  are  desirous  of  first  diverting  any  previously  passed  flow  to  some 
other  (more  tardy)  key  event  which  may  have  a cheaper  penalty  than  the  currently  investigated 
key  event.  This  is  done  in  the  hope  that  any  compression  performed  for  the  current  key  event 
may  also  reduce  the  delay  in  other  key  events  and  thus  achieve  considerable  economy. 
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Assume  the  limit  availability  at  node  l to  be  equal  to  pk  - X*  > 0.  Let 
II(/r)  — [e:  e € ir q(k))\  i.e.,  11(A)  is  the  subset  of  arcs  that  lie  on  the  critical  path(s)  to  node 
(CAT).  Label  node  1 with  (pk  — X.k,  0).  (Recall  that  initially  X*  — 0.)  In  general,  for  any 
labeled  node  / and  any  node  j not  labeled,  such  that  (ij)  6 U(k),  one  of  the  following  two  con- 
ditions will  occur: 

(a) .  1 K and  either  (/)  sj  — 0 and  fj  < atJ;  label  j with(e/t  j_),  where 

€j  - min(«„  r,j)  and  r0  - au  - / j > 0; 
or  (ii)  sj  - 0 and  fj  - a,/,  label  j with  («„  i_). 

(b)  I € K and  either  (i)  sj  — 0 and  /J  < a label  j with  (« jt  O where 

- min(«/  + X„  r(>); 

or  (ii)  sj  - 0 and  fj  - a,y;  label  j with  (e,  + X„  ^). 

For  any  j labeled  and  / not  labeled  (with  the  direction  of  the  arrow  / — » j) , if  sj  - 0 and 
fj  > 0,  label  i with  («,,  £),  where  t,  - min(ey,  fj),  for  w = 1 or  2.  (This  is  the  so-called 
reverse  labeling.) 

If  node  k is  not  labeled  (a  nonbreakthrough  condition),  erase  all  labels  and  go  to  Step  4. 
Otherwise,  node  k is  labeled  and  a flow-augmenting  path  has  been  discovered. 

Increase  the  flow  along  this  path  by  the  amount  ek  (=  the  label  of  node  k)  in  the  usual 
manner  if  condition  (a)  has  occurred,  and  decrease  X,  by  the  maximum  amount  possible  if  con- 
dition (b)  has  occurred,  in  order  of  increasing  v,. 

STEP  4.  Nonbreakthrough  Condition  : This  step  is  reached  when  a nonbreakthrough  con- 
dition is  reached  in  the  process  of  augmenting  the  flow  to  the  currently  most  tardy  note  k € K. 

If  M U K 8 — AT,  go  to  Step  5;  all  tardy  nodes  in  the  set  K have  been  examined,  and  the 
maximum  feasible  flow  to  them  under  the  stated  restriction  on  availabilities  at  node  2.  has  been 
accomplished.  Otherwise,  go  to  Step  2. 

STEP  5.  Stopping  Rule  : For  all  nodes  k € K,  if  either  vk  — 0 or  X*  — pk  when  vk  > 0, 
stop.  Otherwise,  go  to  Step  6. 

STEP  6.  Finding  the  Trial  Cutset : This  step  is  concerned  with  the  detection  of  a cutset  to 
the  key  events.  As  we  shall  see  below,  this  cutset  need  not  be  the  one  whose  arcs  will  eventu- 
ally be  shortened;  hence  the  same  current  trial  cutset,  CTC. 

The  limit  availability  at  node  1 is  now  put  at  oo;  i.e.,  label  1 with  (°°,  0).  For  any  / 
labeled  and  j not  labeled,  if 


(a)  sj  — 0 and  fj  < a„  or  sj  - 0 and  fj  - a,p  label  j with  («,,  O,  where  tj  - min(e„  r0); 
r,j  ” a a - fj  in  the  former  eventuality,  and  r0  — oo  in  the  latter. 

(b)  fj  " a,j  and  either  sj  — 0 or  (sj  < 0 and  sj  > 0),  then  j cannot  be  labeled  from  /.  Arc 
t ij)  is  a member  of  the  CTC. 

Successive  application  of  this  step  will  eventually  result  in  the  detection  of  the  complete 

CTC. 
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STEP  7.  Testing  the  CTC  : The  CTC  determined  in  Step  6 is  checked  for  "feasibility," 
which  refers  to  the  satisfaction  of  the  complementary  slackness  conditions  for  optimality.  Ver- 
ify the  following  condition: 

(7)  Q : {There  exists  k € K,  k not  labeled,  subject  to  tk  - dk  and  X*  > 0} 

There  are  two  possibilities  : 

(a)  Conditions  Q is  false.  Then  the  CTC  is  a feasible  cutset.  Go  to  Step  10. 

(b)  Condtion  Q is  true.  Then  the  CTC  is  an  infeasible  cutset  under  current  flow  conditions. 
We  must  determine  either:  (1)  another  cutset  to  the  right  of  the  CTC  that  is  of  equal 
capacity  but  for  which  condition  Q is  false,  hence  it  is  feasible;  of  (2)  modify  the  flow  so 
that  condition  Q is  false  for  the  CTC.  These  two  objectives  are  accomplished  by  the  fol- 
lowing subroutines. 

Consider  every  unlabeled  node  j €[P  n CTC]  as  a source  node  with  label  (ey,0).  For 
each  such  node,  continue  labeling  as  in  Step  3 until  one  of  three  condtions  occurs: 


(i)  A tardy  node  k € K is  labeled  with  e y from  j.  Erase  the  the  e labels  generated  by  this 
node  j only.  Continue  with  another  node  j «[/*  n CTC]. 

(ii)  A tardy  node  k € K is  labeled  with  tk  > tj,  say  j*  - «y  + 8,  8 > 0.  (The  additional 
flow  f)  will  emanate  from  some  node  k in  the  set  K with  X*  > 0;  see  Step  3,  condition 
(b).)  Augment  the  flow  into  node  k by  6,  relabel  node  j with  (ey,  j ),  and  repeat  the  label- 
ing process. 

(iii)  No  tardy  node  k € K is  labeled  from  j.  Retain  the  newly  generated  ey  labels.  Continue 
with  another  node  jtlPn  CTC]. 

The  outcome  of  this  phase  is  a set  of  newly  labeled  nodes  (with  c- labels)  — which_set 
may  be  empty  if  all  nodes  j € [P  D CTC]  result  in  breakthrough  to  some  key  node  k € K — 
and  the  originally  labeled  nodes  to  the  left  of  the  CTC.  The  new  CTC  is  now  defined  by  the 
set  of  arcs  that  separate  the  labeled  nodes  (both  old  and  new)  from  the  unlabeled  ones.  If  the 
new  CTC  shares  at  least  one  arc  with  the  old  CTC,  then  the  new  CTC  is  infeasible;  go  to  Step 
8.  However,  if  the  new  CTC  is  different  from  the  old,  go  to  the  start  of  Step  7 with  the  new 
CTC. 

Step  8.  The  Resolution  of  Infeasibility : The  algorithm  arrives  at  this  step  when  the  CTC  is 
infeasible,  because  there  exist  activities  which  are  the  only  current  cheapest  ones  to  be  shor- 
tened (to  decrease  the  tardiness  of  some  key  event(s)),  but  some  of  these  activities  are  on  a 
path  to  at  least  one  key  event  that  satisfies  condition  Q.  For  these  key  events,  we  either  reduce 
their  X’s  to  zero,  or  a previously  shortened  activity  (or  set  of  activities)  must  be  detected  and 
lengthened  by  an  amount  equal  to  the  shortening  of  the  activities  on  the  CTC,  thus  leaving 
unchanged  the  realization  times  of  these  key  event. 

Define  the  set 

■Si  4 {At:  v*  - 0,  X*  > 0 and  no  j € A ( k ) is  in  P with  positive  flow  into  it}, 

where  A(k)  is  the  set  of  nodes  immediately  following  node  k and  connected  to  it  with  an  arc. 
Note  that,  according  to  the  construction  in  Step  7,  S)  pt  <f>  at  the  outset,  though  it  may  become 
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empty  later  on.  (If  Sj  - <b,  go  to  Step  10.)  In  the  subnetwork  of  unlabled  nodes,  label  each 
k S S 1 as  a source  node  with  (X*,0).  Continue  labeling  until  one  of  the  following,  (a)  or  (b), 
occurs. 


(a)  A node  k'  € K is  labeled.  Augment  the  flow  into  node  k'  in  the  usual  manner  (see  Step 
3).  If  X*  is  reduced  to  zero  for  some  k € S j,  let  S|  — S j — (X).  If  S|  becomes  empty, 
go  to  Step  7.  Otherwise,  label  node  k with  (kkew.  0)  where  X "ew  is  the  reduced  value  of 
X*,  and  continue  labeling  until  a cutset  is  detected.  Eventually,  either  no  node  k € S, 
satisfies  condtion  Q (hence  the  set  5,  is  empty),  in  which  case  return  to  the  start  of  Step 
7,  or  case  (b)  occurs. 

(b)  Node  / cannot  be  labeled  from  node  j.  If  arc  ij  € P,  j labeled  and  / not  labeled,  then  ij  is 
a candidate  for  joining  the  CTC.  (The  manner  in  which  these  candidate  arcs  are  handled 
is  treated  in  Step  9 below.)  If  arc  ji  6 P,  j labeled  and  / not  labeled,  then  ji  joins  the 
CTC. 

At  the  end  of  this  step,  all  possible  candidate  arcs  to  join  the  CTC  are  in  hand.  If  there 
are  such  candidates,  go  to  Step  9.  Otherwise,  if  there  are  no  candidates,  a new  CTC  has  been 
determined  that  is  to  the  right  of  all  nodes  satisfying  condition  Q,  hence  it  is  feasible;  go  to 
Step  10. 

STEP  9.  In  this  step  the  feasibility  of  the  candidate  activities  is  checked.  If  the  candidate 
activities  are  to  the  left  of  all  nodes  satisfying  condition  Q that  lie  on  paths  containing  these 
candidate  activites,  then  they  are  feasible,  in  the  sense  that  they  can  be  lengthened.  Otherwise, 
the  algorithm  continues  its  search  for  the  leftmost  activities  to  be  lengthened.  We  acheive  this 
by  declaring  the  unlabeled  nodes  incident  on  the  candidate  activities  as  temporary  source  nodes, 
one  at  a time,  and  labeling  them  with  T.  For  any  j labeled  with  T,  i not  labeled,  and 

(i)  ij  € P,  s,=  0 and  flj  > 0;  w - 1,  2,  label  / with  T. 

(ii)  ji  € P,  Sj)  - 0 and-/,}  < a,,  or  sjf  — 0,  label  / with  T. 

continue  labeling  until  either 

(a)  A node  in  the  CTC  is  labeled;  erase  all  T labels; 
or 

(b)  Nonbreakthrough  to  any  node  in  CTC  occurs.  A new  set  of  candidate  activities  is  in  hand. 
Change  the  labels  of  those  nodes  that  are  to  the  right  of  (i.e.  occur  after)  candidate  activi- 
ties from  T labels  to  P labels.  Go  to  the  start  of  Step  9.  In  Step  10,  nodes  that  have  P 
labels  are  considered  as  labeled  nodes. 

This  step  terminates  when  labeling  of  all  nodes  T incident  to  the  candidate  activities  result 
in  (a).  A feasible  cutset  is  in  hand.  Go  to  Step  10. 

STEP  10.  Shortening  Activity  Durations  : This  step  is  reached  when  either  the  CTC  is 
declared  feasible,  or  the  reverse  labeling  of  Steps  8 and  9 has  terminated.  In  either  case  we 
have  a cutset  C.  Let  C,  A (set  of  labeled  nodes)  and  C2  A (set  of  nodes  that  are  not  labeled). 
The  forward  arcs  in  C are  to  be  shortened  and  the  reverse  arcs  are  to  be  lengthened. 

(a)  For  all  forward  arcs  of  C,  if 


y,i  > u(J  and  s,J  > 0,  set  8„  - sj; 
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y,j  < u,j  and  sj  < 0,  set  S0  - sj. 

(b)  For  all  reverse  arcs  of  C,  if 

y,j  < Utj.  set  8 ij  - — s,J; 
y<i  - Utj,  set  6(J  - oo. 


(c)  For  nodes  k € K O C2,  determine  v*  — tk  - dk. 

Let  8 denote  the  amount  of  compression  of  the  project  duration,  then  8 is  given  by 

& - min  ({6J,  { vA)) . 

kexnc2 

For  all  j € C2,  change  tj  to  /,  - 8.  Go  to  Step  1. 

Steps  7 and  8 are  concerned  with  the  detection  of  a feasible  cutset,  if  it  exists.  For, 
indeed,  if  condition  Q of  (7)  is  satisfied  and  one  undertakes  the  shortening  of  the  duration  of 
the  CTC,  then  one  would  violate  the  complementary  slackness  optimality  conditions,  since  now 
some  key  event  k will  be  such  that  tk  < dk  and  \K  > 0.  If  a feasible  cutset  is  detected,  it  is 
compressed.  Otherwise,  Steps  9 and  10  purport  to  discover  the  last  shortened  cutset  (which  is 
also  the  most  expensive)  and  lengthen  those  arcs  in  it  that  would  offset  the  shortening  of  the 
other  arcs,  so  that,  for  those  nodes  satisfying  Condition  Q,  their  tk  s remain  equal  to  their  dk  s, 
and  the  complementary  slackness  conditions  are  preserved.  The  whole  procedure  terminates 
either  when  tk  - dk  for  all  k € K or  for  some  key  events  tk  > dk  but  X*  - pk , which  indicates 
that  it  is  more  expensive  to  compress  any  cutset  in  the  critical  subnetwork  P than  to  advance 
the  completion  time  of  these  events,  at  which  time  iteration  is  halted. 

EXAMPLE:  Consider  the  network  shown  in  Figure  2.  There  are  two  key  events:  K — {4 , 
2,}  with  dk  = 14  and  pk  = 4;  </7  -=  27  and  p7  = 10.  For  the  sake  of  clarity  of  the  figures,  we 
subsequently  refrain  from  explicitly  showing  i ttJ  and  /,,  on  each  arc  (y);  the  arc  duration  can  be 
easily  deduced  from  tj  - Initialization,  followed  by  Steps  1 and  2,  results  in  the  critical  sub- 
network shown  in  heavy  lines  in  Figure  3.  Since  v4  — 4 and  v7  — 6,  node  7 is  the  most  tardy 
node.  Step  3 is  initiated  with  (10,  0)  at  node  1_,  since  p7  - 10  and  X7  - 0.  The  first  "go 
around"  of  Step  3 terminates  with  the  flows  shown  in  Figure  3,  with  no  breakthrough  to  node 
7 . It  is  reinitiated  with  k — 4 and  labeling  (4,  0)  at  node  I_,  to  result  in  the  second  go  around, 
with  no  breakthrough  to  node  4 and  the  flows  as  shown  in  Figure  4.  Since  now  M — K,  the 
conditions  of  Steps  4 and  5 lead  to  Step  7,  and  it  is  easy  to  see  that  the  cutset  is  feasible  (since 
neither  v4  nor  v7  equals  zero),  and  C,  - ((2,3),  (6,7)}  C />,  as  shown  in  Figure  5.  Here,  C, 
" (1,2, 5,6},  C2  “ (3,4,7},  and  8,  — 1.  Step  9 shortens  the  activities  in  C by  1 unit,  resulting 
in  the  node  realization  times  shown  in  Figure  6.  Note  that  both  tardy  nodes  have  advanced  in 
time  by  8:  node  4 now  is  realized  at  time  17  and  node  6 at  time  32.  Both  are  still  tardy.  This 
compression  step  has  cost  2 + 2 ™ 4 units  but  saved  4+10  ■■  14  units,  an  obvious  economic 
advantage.  Moreover,  the  second  arc  between  nodes  2 and  3 is  introduced  to  carry  the  flow 
fly  since  s2,3  - 0 and  /2  3 -2  - a2  3.  Iteration  is  returned  to  Step  1,  with  node  7 as  the 
most  tardy  node.  Node  1^  is  now  labeled  (8,  0),  since  p2  — X7  — 8.  Flow  maximization  results 
in  saturating  arc  (1,2),  and  the  nonbreakthrough  condition  is  quickly  reached.  The  next  most 
tardy  node  is  4,  but  no  additional  flow  can  be  passed  to  it;  therefore,  the  minimal  cost  is  in 
hand,  since  M — (4,7);  it  is  C2  * 1(1,2)}  C P (see  Figure  7).  It  is  easy  to  see  that  condition 
Q is  not  satisfied,  and  that  8 - Shortening  the  project  duration  by  3 units  results  in  the 

node  time  realization  shown  in  Figure  8.  Now  node  7 is  the  only  tardy  node,  and  it  is  obvious 
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Legend 


Figure 4.  Labeling  Tor  (low  augmentation  to  npde  4 


Legend 


Figure  S.  Resultant  cutset 
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that  no  additional  flow  can  be  sent  to  it,  since  arc  (1,2)  is  saturated.  Therefore,  the  cutset  C3 
- {(1,2)}  C P.  Unfortunately,  Condition  Q of  (7)  is  true  for  node  4,  since  /4  - 14  - d4  and 
X4  — 2.  Consequently,  activity  (1,2)  cannot  be  shortened,  and  Step  7(b)  is  initiated. 

Node  2 is  labeled  (e2  0)  (see  Figure  9)  leading  to  labeling  of  nodes  S_,  6,  and  7,  a 
breakthrough  (Step  7(i)).  All  « labels  are  then  erased.  Since  node  2^  is  the  only  labeled  node 
in  the  CTC,  we  conclude  that  it  is  infeasible,  and  go  to  Step  8. 


I 


Step  8 specifies  labeling  of  node  3 with  (2,  4)  (see  Figure  10).  Node  2^  cannot  be  labeled 
from  3 because  f] } while  s23  — 0;  hence  no  other  node  can  be  labeled,  and  Step  8(b)  is  ini- 
tiated. Since  arc  (2,3)  e Pand  node  3^  is  labeled  but  node  1_  is  not,  arc  (2,3)  is  now  a candidate 
for  joining  the  CTC.  Node  4 is  the  only  node  in  the  set  S,  and  it  is  labeled,  so  arc  (2,3)  is  the 
only  such  candidate.  Step  9 requires  labeling  2_  with  T (shown  also  in  Figure  10),  which  is  in 
the  CTC  indicating  that  arc  (2,3)  is  to  the  left  of  all  nodes  satisfying  Condition  Q,  hence  the 
T -label  is  erased  (Step  9(a)).  The  cutset  in  hand  is  feasible.  The  set  of  labeled  nodes  is  C]  ** 
{1,3,4};  the  set  of  unlabeled  nodes  is  C2  - {2,5,6,7},  with  the  cutset  C4  - {(1,2),  (2,3)}  C P, 
as  shown  in  Figure  11.  It  is  easy  to  deduce  that  8 — 1,  and  the  subsequent  compression  step 
shortens  activity  (1,2)  but  simultaneously  lengthens  activity  (2,3)  by  one  unit.  The  realization 
time  of  node  4 is  left  unaffected  at  14,  whereas  the  time  of  realization  of  node  7 is  decreased 
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by  1 unit.  The  situation  now  is  as  shown  in  Figure  12.  Note  the  second  arc  of  infinite  ’capa- 
city" between  nodes  1_  and  2^  introduced  because  now  S{  2 - 0.  Since  node  7_  is  still  the  only 
tardy  node,  the  iterations  are  initiated  with  node  1_,  labeled  with  (7,  0),  since  p7  - X7  — 7. 
Flow  maximization  saturates  arc  (5,7),  resulting  finally  in  the  cutset  Cs  ■»  {(5,7),  (6,7)). 
Compressing  the  duration  of  the  project  by  8 — 1 — min{</7  - r7;  t1  - /Ji7;  i1  - l61),  node  T_ 
reaches  its  due  date  and  iteration  is  halted.  Figure  13  gives  the  optimal  solution.  The  cost  of 
compression  is  30,  and  the  gross  savings  amount  to  76;  hence,  the  net  gain  is  46  units. 


I 


! 


CONCLUDING  REMARKS 


For  the  sake  of  brevity  in  exposition  we  chose  a small  sample  project  of  only  12  activities 
and  seven  nodes.  Consequently,  it  did  not  exhibit  all  the  possibilities  that  may  arise  in  the 
course  of  iteration.  (For  instance,  this  example  did  not  permit  a breakthrough  to  a tardy  node 
from  a node  in  the  set  5t.)  In  a separate  report  [6]  we  present  a larger  example,  in  which  all 
the  branches  of  the  algorithm  are  taken,  together  with  the  computer  code  and  some  experimen- 
tal results.  For  the  moment,  it  suffices  to  indicate  that  our  preliminary  trials  with  networks  of 
up  to  10  nodes  and  18  arcs  and  only  two  key  events  were  solved,  and  they  consumed  between 
0.4  and  0.9  seconds  on  the  IBM  370/175. 

We  have  advocated  a network  flow  algorithm,  in  lieu  of  a frontal  attack  on  the  LP  of  (1), 
in  order  to  capitalize  on  the  special  structure  of  that  LP.  Therefore,  it  would  be  of  interest  to 
determine  an  upper  bound  on  the  number  of  computations  required. 

The  complexity  of  the  proposed  algorithm  can  be  gleaned  from  the  following  calculation. 
We  assume  that  all  durations  and  due  dates  are  integers.  It  has  been  shown  [1]  that  to  acheive 
flow  maximization  requires  0 (A2n)  computations.  There  are  at  most  K < n tardy  nodes,  each 
of  which  may  generate  a CTC  which,  in  turn,  would  initiate  new  labelings  in  search  of  a feasi- 
ble cutset.  The  resulting  search  would  require  at  most  0(A2n)  calculations,  repeated  at  most 
n-2  times  (since  there  are  at  most  that  many  CTCs  in  a network  of  n nodes).  Thus,  to  locate  a 

feasible  cutset  or  declare  a CTC  infeasible  would  require  at  most  K x 0(A2n)  + y(n-2) 

x 0(A  2n)  calculations.  If  infeasibility  of  the  CTC  is  established,  reverse  labeling  is  initiated  for 
each  node  k € K 0 satisfying  Condition  Q.  Since  there  are  at  most  K such  nodes,  this  step 
would  add  at  most  K x 0 (A2n)  calculations.  Compressing  the  project  duration  involves  the 
arcs  in  the  feasible  cutset  as  well  as  the  nodes  in  the  set  K.  This  adds  up  to  at  most  A + K cal- 
culations. Finally,  assuming  that  the  problem  was  originally  stated  in  integers,  each  6 is  > 1, 


« 


348 


S.  E ELMAGHRABY  AND  P S PULAT 


and  there  may  be  at  most  £ v*  compressions,  i.e.,  repetitions  of  the  whole  procedure.  Total- 
ity 

ling  up  the  individual  steps,  we  obtain 

[K  x 0 (A2n>  + ± (n- 2)  x 0(/lJ/i)  + K x 0C42*)  + (A  + *)]  £ v* 

2 *€K 

< ( £ v*|  x 0(i42n3), 

[kiK  | 

since  K < n.  Our  computing  experience,  though  by  no  means  conclusive,  indicates  very  favor- 
able times  on  the  computer  using  the  proposed  algorithm,  versus  direct  LP  solution. 
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ABSTRACT 

We  reformulate  the  cost  equation  for  the  lot-size  model  with  partial  back- 
logging.  The  formulation  is  in  terms  of  "fictitious  demand  rate,"  a new  invento- 
ry decision  variable  that  simplifies  the  analysis.  Using  decomposition  by  projec- 
tion, we  obtain  an  optimal  solution  in  a straightforward  manner.  The  form  of 
the  solution  sheds  additional  light  on  the  behavior  of  the  model.  Some  of 
these  insights  are  elucidated  by  numerical  examples. 

INTRODUCTION 

I 

Most  works  in  inventory  theory  on  infinite-time-horizon  lot-size  models  have  been  con- 
cerned with  the  extreme  cases,  wherein  all  demand  occurring  during  stockout  is  backlogged  or 
not  backlogged  (lost  sales).  The  abundance  of  such  models  contrasts  sharply  with  the  scarcity 
of  inventory  models  that  consider  the  hybrid  situation  of  partial  backlogging.  A realistic  appli- 
cation of  the  partial-backlogging  concept  is  in  the  demand  for  spare  parts.  Intuitively,  it  seems 
reasonable  to  assume  that,  during  stockout,  critical  needs  will  be  satisfied  from  other  sources 
and  less  urgent  needs  will  be  met  by  backordered  items. 

The  scant  inventory  literature  on  infinite-time-horizon  lot-size  models  with  partial  back- 
logging  contains  only  one  such  model  for  which  an  optimal  solution  has  been  obtained  (111,  PP- 
256-259).  The  purpose  of  this  paper  is  to  show  that  the  analysis  of  this  solved  model  and  the 
mathematical  form  of  the  resulting  optimal  solution  can  be  greatly  simplified.  This 
simplification  results  from  reformulating  the  model  in  terms  of  a new  inventory  decision  vari- 
able, which  we  term  the  "fictitious  demand  rate"  (FDR).  The  decision  variable  FDR  is  a crucial 
modeling  concept  in  the  analytical  study  of  monopoly  price  — inventory  models  12] . An 
important  byproduct  of  the  simplified  analysis  of  partial  backlogging  is  a new  economic  interpre- 
tation of  the  circumstances  under  which  this  operating  doctrine  is  optimal. 

The  remaining  sections  of  the  paper  review  the  optimization  procedure  of  Montgomery, 
Bazaraa,  and  Keswani  (MBK)  tl] , develop  the  revised  version  of  the  infinite-time-horizon  lot- 
size  model  with  partial  backlogging,  establish  an  optimal  policy,  discuss  and  interpret  the  policy, 
and  give  numerical  illustrations. 

r 

BACKGROUND 

The  following  variable-cost-rate  model  for  a lot-size  inventory  system  with  partial  backlog- 
ging is  given  in  ([1]  p.  256): 
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(la) 


K(Q,  s ) - 


AD 


Q + (1  - b)S 
ifbS 2 


; + 


1C(Q  - bS)> 


irSD 


2lQ  + (1  - b)S]  Q + (l-b)S 
tt0(1  - b)SD 


2[Q  + (1  - fr)S]  Q + (1-6)S* 


where 


D 

Q 

C 

l 

A 

S 

it 

n 

b 


demand  rate  (DR),  D > 0, 
order  quantity,  Q > 0, 
unit  cost,  C > 0, 

carrying  rate  as  a per  cent  of  unit  cost,  / > 0, 
cost  per  order,  A > 0, 

stockout  demand  per  inventory  review  cycle,  S > 0, 
unit-shortage  penalty,  7r  ^ 0, 
backorder  unit-shortage  cost  rate,  n ^ 0, 
unit  profit,  n0  ^ 0, 

fraction  of  stockout-demand  backordered,  0 < b < 1. 


The  nonconvexity  of  (la)  motivated  MBK  to  create  the  ad  hoc  optimization  procedure 
which  we  proceed  to  outline.  By  use  of  the  nonsingular  transformation 


U = Q + S(1  - b) 
V = Q - bs 


model  (la)  became 


(lb)  K(U,  V)  = ^ + 


AD  , ICV2  . nD(U  - V)  , n(U  - V)2  ^(1  ~ b)(U  - V) 
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Observing  the  nonconvexity  of  (lb),  MBK  applied  the  projection  concept.  To  facilitate  the  use 
of  projection,  the  transformation 


P — 


U 


was  applied  to  (lb),  which  became 
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Y(U,  p)  = —jj-  + ttD  4-  itoDil  - b)(l  - 0)  + U 
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Then  decomposition  by  projection  was  applied  sequentially  in  the  following  manner: 


Y(U *,  p*)  = min  min  Y(U,  p)  = min  Y(U,  p). 

0 «!  U 0<\.U 


The  outer  minimization,  unfortunately,  was  not  straightforward.  This  optimization  difficulty  is 
circumvented  by  our  proposed  reformulation  which  yields  a sequence  of  strictly  convex  sub- 
problems. 


REFORMULATION 


Model  (la)  is  based  on  the  assumption  of  a uniform  demand  rate,  which  implies  that  the 
following  formula  for  inventory  review  cycle  length  T holds: 


T - IQ  + (1  - b)S)/D. 

For  expository  convenience  we  rewrite  model  (la)  in  terms  of  T, 

(10  K(Q,  S)  **  — + imjSli  + JLS+  nbS2  . *„(!  ~ b)S 
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The  analysis  will  be  greatly  simplified  if  we  introduce  the  new  inventory  decision  variable, 
fictitious  demand  rate  X,  which  we  define  by  means  of  the  following  transformation: 

X - (Q  - bS)/T. 

Substituting  Tin  the  appropriate  places  in  model  (lc),  we  obtain  the  following  reformulation: 

(2a)  C(X,  T)  - j + + n(D  - X)  + + tt0(1  - b)(D  - X). 

In  Figure  1 we  give  the  geometry  of  partial  backlogging  and  indicate  the  key  decision  vari- 
ables the  reader  has  encountered  up  to  this  point.  From  a geometric  standpoint  we  are  model- 
ing the  stockout  level  as  the  product  of  the  inventory  review  cycle  length  T and  the  term 
(DR  - FDR),  which  is  the  difference  between  the  actual  demand  rate  and  an  artificial  demand 
rate. 


INVENTORY  LEVEL 


Preparatory  to  seeking  an  optimal  solution,  we  write  model  (2a) 
equivalent  form, 


(2b) 


C(X,T)  - X 


(1C  + i rb)T 


2 D 


X - [nbT  + n + »r0(l  - b))\  + j + 


in  the  following 

nbDT 

2 


+ (rr  + rr0(l  - o))D. 


We  shall  assume  that  model  (2)  is  twice  continuously  differentiable,  since  this  validates  the 
subsequent  use  of  the  projection  technique  for  obtaining  an  optimal  solution. 
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OPTIMAL  SOLUTION 

We  obtain  an  optimal  solution  by  applying  decomposition  by  projection  in  the  following 
stepwise  manner: 

CW,  T •)  - min  min  C(X,  T)  - min  C(X.  T). 

T X X.T 

For  fixed  positive  T \ (2b)  is  strictly  convex  in  X.  Hence,  the  optimal  fictitious  demand  rate 
X*{T)  is  easily  obtained  from  model  (2b), 

(3a)  X*(T)  - YnbT  + it  + 7r0(l  - b)]D/lUC  + i rb)T), 

(3 b)  if  f > [tt  + 7r0(  1 - b)]//C. 

We  now  substitute  X*(T)  into  model  (2b),  which  yields  the  following  expression  in  T : 

(4)  C[X*(T).  T)-[A  — Dlir  + tt0(1  - b))2/2(nb  + lC))r 1 

+ t rbD[IC/(nb  + /C)]r/2  + In  + 7r0(l  - b)][IC/(.nb  + IC)]D. 

Model  (4)  is  strictly  convex  in  X Thus  the  optimal  inventory-review-cycle  length  T*  is  easily 
obtained  from  the  above  expression  and  is  given  below: 

(5)  T*  = ({2/1  (nb  + 1C)  - hr  + -tt0(1  - b)Y D)lnblCI^n . 

We  now  obtain  the  minimum  cost  rate  solution  C( X*.  T *)  by  substituting  T*  for  T in 
model  (4), 

(6)  C(X •,  T*)  = [nbICD[2A(nb  + 1C)  - [n  + 7r0(l  - b)]2 D])'/2/(nb  + 1C) 

+ (ir  -E  tt0(1  - 6)H/C/(w6  + IC)\D. 


If  we  now  substitute  T*  for  Tin  inequality  (3b),  we  get,  after  simplifying,  the  following 
inequality: 

(7)  2A-  12  > n + 77-0(1  ~ 

ICD\  1C 

The  above  inequality  is  equivalent  to  its  counterpart  ([1],  p.  259),  but  here  has  been  put  into 
the  more  meaningful  form. 

The  optimal  policy  can  now  be  stated  with  the  above  inequality  serving  as  a test  criterion. 
Satisfaction  of  (7)  indicates  that  a partial  backlogging  solution  is  optimal;  otherwise,  the  solu- 
tion of  the  classical  lot-size  model  is  optimal. 

In  words,  the  left  side  of  inequality  (7)  is  the  classical  infinite-time-horizon  formula  for 
the  optimal  interval  between  replenishments.  Therefore,  we  can  describe  the  optimal  policy  in 
a more  informative  way.  Whenever  the  optimal  inventory-review-cycle  length  computed  by  the 
formula  derived  for  the  classical  lot  size  model  exceeds  the  test  criterion  on  the  right  side  of 
(7|.  partial  backlogging  is  optimal.  Otherwise,  the  classical  lot-size  operating  doctrine  should  be 
employ  ad 


mi  dei  ad  1 he 


idol  criterion  on  the  right  side  of  inequality  (7)  we  will  gain 
adtK-h  the  optimal  policy  specifies  partial  backlog- 
of  the  test  criterion  ratio  contains  parameters 
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that  appear  nowhere  else  in  the  inequality.  This  implies  that,  for  any  given  value  of  the  left 
side,  under  suitable  conditions,  namely,  the  value  of  the  numerator  of  the  right  side,  the  right 
side  can  exceed  the  left  side. 

The  terms  comprising  the  numerator  have  an  economic  characterization.  They  represent 
penalty  costs  incurred  when  a demanded  item  is  not  inventoried.  Thus  the  economic  content 
of  inequality  (7)  is  that,  whenever  the  penalty  for  not  inventorying  demanded  items  is  rela- 
tively small,  then  partial  backlogging  is  a viable  operating  doctrine.  In  the  numerical  examples 
given  below,  this  economic  result  is  illustrated.  We  will  demonstrate  the  fact  that  the  value  of 
the  right  side  of  (7)  can  be  varied  to  the  extent  that  the  optimal  operating  doctrine  will  be 
changed  by  variation  in  the  unit  profit. 

NUMERICAL  EXAMPLES 

We  now  introduce  numerical  cases  to  elucidate  the  concepts.  Both  cases  have  the  follow- 
ing data  in  common: 

D - 250,  C - 10,  / - 0.2, 

A - 10,  ir  - 0.2,  n - 0.1,  b - 0.5, 


, 

i 


CASE  1,  ir0-  0.2: 

(7)  12(10)/0.2(10) (250)1 1/2  - 0.2  > °'2  + ^ 1 ~ ° S)  - 0.15. 

The  above  computation  implies  that  the  partial  backlogging  operating  doctrine  is  optimal.  The 
optimal  replenishment  interval  is 

(5)  t-.  _ [{2(10)10.1(0.5)  + 0.2(10)]  - [0.2  + 0.2(1  - 0.5)] 2(250) }/0. 1 (0.5) (0.2) (10) (250) ) ‘/2 

- 0.86. 


# 


CASE  2,  ir0  — 2: 
(7) 


0.2  < 


0.2  -I-  2(1  - 0.5) 

0.2(10) 


0.6. 


The  above  computation  implies  that  the  classical  lot-size  operating  doctrine  is  optimal.  The 
optimal  replenishment  interval  is  obviously  0.2. 
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ABSTRACT 

We  examine  (he  problem  of  a gambler  interested  in  maximizing  the  expect- 
ed value  of  a convex  utility  function  of  his  fortune  after  n plays  of  a game.  We 
allow  any  probability  distribution  to  rule  (he  outcome  of  each  play,  and  this  dis- 
tribution may  change  from  play  to  play  according  to  a Markov  process.  We 
present  results  regarding  the  existence  of  an  optimal  policy  and  its  structural 
dependence  on  the  gambler's  fortune.  The  well-known  results  of  Bellman  and 
Kalaba  for  exponential  and  logarithmic  utility  functions  and  coin-tossing  games 
are  generalized.  We  also  examine  the  situation  of  general  state  spaces  and 
show  that  the  same  structural  results  hold. 

1.  INTRODUCTION 

Consider  the  following  scenario:  A gambler  has  a fortune  x.  He  knows  that  the  mechan- 
ism against  which  he  is  playing  is  in  some  state  i € (0.  1,  2,  . . . J.  He  can  place  any  positive 
wager  y not  exceeding  his  fortune  (0  < y < x).  The  mechanism  will  then  be  set*  in  motion, 
and  when  it  stops  his  fortune  will  bex  + Aj,  where  R,  is  a random  variable  with  known  dis- 
tribution Gr  After  this,  the  state  of  the  gambling  mechanism  changes  to  j,  with  known  proba- 
bility /*„,  independent  of  . The  gambler  is  informed  of  the  new  state  of  the  mechanism  and 
is  allowed  to  place  a new  wager,  the  process  repeating  itself  a predetermined  number  of  times, 
n. 

We  consider  gamblers  who  are  interested  in  maximizing  the  expected  value  of  a utility 
function  V of  their  fortune  at  the  end  of  n plays.  The  problem  is  to  determine  the  structure  of 
the  optimal  wager. 

Previous  authors  [1,2,4,7,9,10]  have  examined  similar  problems.  They  have,  however, 
restricted  themselves  to  coin  tossing  games  (i.c.,  R.  can  only  take  the  values  ±1)  and  utility 
functions  that  are  either  of  the  power  type  or  logarithmic  type.  The  notion  of  different  states 
for  the  gambling  mechanism  has  not,  to  our  knowledge,  been  presented  in  the  literature.  The 
present  paper  will  allow  Ji,  to  be  a general  random  variable,  with  the  only  conditions  being 
, < -1]  - 0 (i.e.,  the  loss  is  limited  to  the  wager)  and,  for  some  real  number  9, 
EfT  <#<«>. 


•Partially  supported  by  the  U.S.  Army  Research  Office  under  Grant  DA  AG29-77-0040  with  the  University  of  Califor- 
nia. Reproduction  in  whole  or  in  part  is  permitted  for  any  purpose  of  the  United  Slates  Government. 
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The  utility  function  ^ will  be  allowed  to  be  any  function  that  is  increasing,  concave  and 
right  continuous  at  the  origin. 

The  past  twenty  years  have  been  a rebirth  of  interest  in  gambling  theory,  which,  after  all 
spawned  probability  theory  (see  Epstein  [5]).  Dubins  and  Savage’s  work  14]  considers  unfavor- 
able gambling  situations  and  the  optimal  strategies  for  these  games.  They  prove,  among  other 
things,  that  if  the  gambler’s  goal  is  to  reach  a fortune  of  N before  going  broke  and  he  is  allowed 
even  money  wagers  with  probability  P < 1/2  of  success,  then  bold  play  (bet  min  (/V  - x,  *1, 
where  jr  is  his  fortune)  is  optimal.  Ross  110}  also  considers  coin-tossing  games  with  P < 1/2 
and  shows  that  playing  timidly  (i.e.,  betting  the  minimum)  maximizes  the  expected  playing 
time  until  the  gambler  goes  broke. 


The  first  modern  day  author  to  consider  coin  tossing  games  with  P > 1/2  is  Kelly  17]. 
He  shows  that  if  the  gambler  wishes  to  maximize  jiim  log  Sn,  where  S„  is  the  gambler’s  for- 
tune after  n plays,  and  he  is  restricted  to  betting  a constant  proportion  of  his  fortune  at  each 
toss  of  a coin,  then  he  should  bet  the  proportion  (Ip  - 1).  Bellman  and  Kalaba  [ll,  using 
Kelly  s model,  show  that  betting  the  proportion  (Ip  - 1)  maximizes  £ log  S„  for  all  n. 


Brennan  (2)  generalizes  Kelly’s  model  and  proves  that,  for  games  with  P > 1/2,  the  gam- 
bling  system  which  maximizes  £ log  S„  asymptotically  minimizes  the  expected  time  until 
5*  > x (for  sufficiently  large  x)  and  asymptotically  maximizes  P[S„  > y]  (for  sufficiently  large 

n,  and  every  y).  Brieman  s work  is  the  basis  for  a number  of  papers  which  advocate  maximiz- 
ing £ log  S„. 


Thorp  [12)  gives  a good  overview  of  the  various  games  available  today  which  are  favor- 
able  to  the  gambler.  Pasternack  [9]  considers  coin-tossing  games  but  discounts  money  over 

time,  and  he  finds  conditions  under  which  the  gambler  is  better  off  by  making  risk-free  invest- 
ments. 


In  Section  2 of  this  paper  we  examine  the  general  model  of  a gambler  and  determine  the 
existence  of  an  optimal  policy  as  well  as  the  structural  properties  of  the  optimal  expected  utility. 

In  Section  3,  we  extend  Bellman  and  Kalaba’s  fl)  results  to  our  more  general  model. 


Section  4 examines  the  dependence  of  the  optimal  wager  on  the  gambler’s  fortune. 
Section  5 indicates  how  the  results  can  be  extended  to  more-general  state  spaces. 


Throughout  this  paper  we  use  the  term  "increasing"  to  mean 
explicit  "strictly  increasing"  to  mean  exactly  that. 


"nondecreasing"  and  use  the 


2.  FORMULATION  OF  MODEL 


Let  '•  be  tbe  expected  utility  when  the  player  begins  a sequence  of  n plays  with  a 
fortune  of  x,  the  (known)  state  of  the  gambling  system  is  /,  and  strategy  n is  followed. 


Define  V„[x,  i ] - sup  Vn[x,  i,  n], 

7T 


Following  the  usual  dynamic  programming  formalism,  set 

Kb,  i,  y]  - £ P„  £K„_,  [x  + R,  y,  j) 
j ~~ 
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and  we  obtain  the  functional  equation 

sup  V„[x,  i,y\. 

(The  integrability  of  F„lx,  /]  will  follow  from  Theorem  2.1  below.) 

We  now  proceed  to  establish  the  properties  of  V„lx,  /].  We  will  require  the  following: 

LEMMA  2.1:  Let  f(x,  y)  be  concave  on  {(x,  y)  | x > 0.  0 < y<  x).  Let 
0)  g (x)  - sup  /(x,  y). 

Then 

(a)  /?(x)  is  concave  in  x,  hence  continuous  in  x ; 

(b)  if  /(x,  y)  is  increasing  in  x,  then  g(x)  is  increasing  in  x ; 

(c)  if  f(x,  y)  is  differentiable  in  both  x and  y and  for  every  x > 0 the  maximizer  of  the 
right-hand  side  of  (1),  which  we  denote  by  y(x),  has  y(x)  > 0,  then  g(x)  is 
differentiable,  with 

(2)  g'U)  - A lx.  y(x)]  + U y(x)J. 

PROOF:  The  proofs  of  (a)  and  (b)  are  routine.  To  establish  (c)  it  suffices  to  show  that 
for  every  x > 0 there  exists  only  one  a having 

(3)  g(x)  - ax  < g(x)  - ax  for  all  x > 0. 

Let  a satisfy  (3)  for  fixed  x,  and  let  y - y(jr)  and  ii  - x - y.  For  every  y > 0 we  get 
/(«  + y.  y)  - «(«  + y)  < g(u  + y)  - a(u  + y) 

< g(x)  - a(u  + y)  - /(«  + y,  y)  - a(u  + y). 

Thus  the  differentiable  function  in  y,  f(u  + y,  y)  - a(u  + y),  attains  its  maximum  over 

ly|y  >0}  at  y.  This  assures  that  its  derivative  at  y is  zero,  which  proves  (2). 

The  properties  of  F„lx,  /l  now  follow  by  induction  from  Lemma  2.1  and  the  observation 
that,  with  0 - max{l,  1 + 0),  Vn(x,  i)  < F(x0'’). 

THEOREM  2.1:  For  all  i,  V„ lx,  /]  is  increasing,  concave,  and  continuous  in  x and 
increasing  in  n.  In  particular,  this  assures  that,  for  every  n,  x,  and  / there  exists  an  optimal 

wager  y„(x,  i)  having  Vn lx,  i,  y„(x,  i) ] — V„[x,  /J.  Also,  if  Fix)  is  strictly  increasing  and 

differentiable,  so  is  F„(x,  /]  for  all  n and  i. 

From  this  theorem,  it  follows  that  we  can  rewrite  the  optimality  equation  as 
y„lx,  i)  - max  F„_,  lx,  i,  y) 

0<y<JT 

Folx,  /)  - Fix). 

Let  y„fx,  /]  be  the  optimal  wager,  as  determined  from  this  equation.  If  it  is  not  unique, 
we  will  allow  y„(x,  /)  to  be  either  the  smallest  or  the  largest  of  such  values,  although  we  will 
assume  consistency  in  this  choice. 
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From  the  properties  of  V„[x,  /],  one  can  easily  establish 

PROPOSITION  2.1:  If  £R,  < 0,  then  y„(x,  i)  - 0. 

PROOF:  By  Jensen’s  inequality 

y„[x,  /]  < max  '£tPIJ  V„_,  [x  + yER, . j\, 

j ~~ 

and  the  result  follows,  since  Vn_x lx.  j)  is  increasing  in  xand  V„[x,  /]  > K-i  lx,  Jl 

/ 

This  result,  of  course,  demonstrates  the  reason  for  calling  concave  utility  functions  "risk 
averse."  We  will  in  the  sequel  assume,  unless  otherwise  stated,  that  £R,  > 0 and  consider  this 
our  definition  of  favorable  games. 

By  imposing  some  structure  on  the  random  variables  R,  , one  can  obtain  monotonicity 
results  for  the  dependence  of  V„(x,  i)  on  /.  Call  the  random  variable  R,  stochastically  increasing 
in  / if  P(Rj  > r)  is  increasing  in  i for  all  r.  It  is  well  known  (e.g.,  [8])  that  in  this  case 
Ef(R, ) is  increasing  in  / for  every  monotone  function  / Also,  call  a stochastic  matrix 
P monotone  ( e.g.,  13,6])  if,  for  every  k,  £ P„  is  increasing  in  /.  In  this  case,  the  rows 

J-k 

of  the  matrix  are  the  distributions  of  a stochastically  increasing  sequence  of  random  variables. 
So  £ /*,/  a,  is  increasing  for  every  monotone  sequence  (a,).  In  particular,  this  implies  that 

i 

£ P„  a,j  is  increasing  in  i whenever  {aj  is  increasing  in  both  i and  j. 

i 

From  the  above,  one  can  prove  by  induction 

PROPOSITION  2.2:  Assume  that  R,  is  stochastically  increasing  in  / and  the  matrix  of 
transition  probabilities  is  stochastically  monotone.  Then  V„  [x,  /]  is  increasing  in  i. 

The  two  simplest  cases  of  stochastically  monotone  matrices  are  matrices  having  all  rows 
coincide  (corresponding  to  independent  choice  of  the  gamble  at  each  stage)  and  the  identity 
matrix  (corresponding  to  the  same  game  played  repeatedly). 

It  is  easy  to  find  examples  that  show  that  this  monotonicity  result  no  longer  holds  if  one 
merely  assumes  that  the  gambles  are  ordered  stochastically  and  does  not  impose  special  condi- 
tions on  the  transition  matrix. 

Let  V[x]  — x.  The  3 gambles  available  are  coin  tosses  with  probabilities  of  winning  0.6, 
0.7  and  0.8  respectively.  The  transition  matrix  is 

1 0 0 

P - 0 1 0 . 

1 0 0 

Clearly,  all  conditions  except  the  monotonicity  of  P are  satisfied,  yet  one  can  verify 
y„lx,  2]  — (0.7)"  2"  x, 

Vn[x,  31-0.8  (0.6) 2"  x, 
and,  for  all  n >2,  V„[x,  3]  < V„[x,  2]. 
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3.  SOME  SPECIAL  UTILITY  FUNCTIONS 


Among  the  many  functions  that  fit  out  requirements  for  a utility  function,  some  have 
received  great  attention  in  the  literature.  Among  them  are  the  logarithmic  and  power  function, 
for  which  we  can  find  simple  forms  for  the  Vn[x,  /]  and  y„lx.  /). 


THEOREM  3.1:  If 
(a)  V[x)  - log  x 


(b)  Vlx]  -x^/p,  0 <1,  0 * 0, 
then  we  have  respectively 

(a)  V„[x,  /]  - V„[l,  /J  + log  x 


(b)  K,U,/1-  y„H.i)  x*. 

and  in  both  cases  the  optimal  wager  is  given  by  y„(.x.  i ) - a(/)x,  where  a(/)  is  determined  by 
solving  the  problem 

(a)  max  £ log  (1  + aR,) 

0<o<l 


(b)  max  £(1  + aR,)1*, 

0<a<l 

min  £(1  + aR )», 

0<o<l 

and  does  not  depend  on  n or  x. 


The  proof  in  all  cases  is  a simple  induction  on  n. 


These  results  generalize  those  of  [1]. 

These  utility  functions  have  constant  proportional  risk  aversion.  It  is  known  (e.g.,  (II)) 
that  in  this  case  the  decision  to  accept  or  reject  a proportional  gamble  is  independent  of  the 
gambler’s  wealth.  This  explains  why  y„(x,  i)  is  a scalar  multiple  of  x,  with  the  scalar  being 
independent  of  n. 


4.  DEPENDENCE  OF  THE  OPTIMAL  STRATEGY  ON  THE  FORTUNE 


We  now  return  to  the  general  setting  of  Section  2 and  investigate  the  dependence  of  the 
optimal  wager  y„(x,  i)  on  the  gambler's  fortune  x.  From  the  results  of  the  previous  section,  it 
is  appealing  to  generalize  and  postulate  that  either 

(a)  y„(x,  i)  is  increasing  in  x 


yn( x,  i ) is  monotone  in  x (increasing  or  decreasing) 
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Both  of  these  properties  do  not  necessarily  hold,  as  shown  by  the  example 


* - *72  for  0 < x < 0.8, 
Vlx]  " 0.32  + 0.2*  for  0.8  < *. 


that 


The  gamble  is  a coin  toss:  /*l/t  ■»  1]  « 0.6,  /*[/}  -»  —1]  — 0.4.  One  can  easily  show 


>,(*)  - 


*,  0 < x < 1/6, 

0.2(1  - *),  4/6  < * < 3/4, 
* - 0.7,  3/4  < *, 


1 


which  is  clearly  not  monotone  in  *.  One  can  also  verify  that  — y{  (*)  is  not  monotone. 


One  can  then  ask  if  there  exist  simple  functions  of  xand  y„  (*,  /)  which  are  monotone  in 
x The  search  for  such  functions  is  greatly  assisted  by  Topkis’  results  on  the  minimization  of 
submodular  functions  on  a lattice  [13]. 


Let  R,  be  a random  variable  with  /»[_£,  > -1]  - 1.  Define  p,  - sup  {r  > 0|/*[0  < 
JR,  < r ] -"O).  Note  that  p,  > 0 or  p,  - -oo. 


THEOREM  4.1:  Assume  the  state  of  the  gambling  system  is  /.  Assume  p,  > 0.  Then 
* + p,y„(*.  /')  is  increasing  in  *. 


PROOF:  Recall 


Vjx.  i]  - max  £ P,j  £T„_,  [*  + R,  y,  j]. 

i — 


By  making  the  substitution  v - * + p,  y we  have 

V. 


[*,  <1  - -min  Pu  £F„_,  * 1 - v,  Jl 

' i P>  P>  jl 


(4a) 

(46)  subject  to  * < v < *(1  + p,). 

Clearly  this  constraint  set  is  a sublattice.  Now  consider 


-t'.-iMi-f  +7--.JI 

Pi  Pi 


For  R < 0,  1 - — > 0 and  — < 0. 

Pi  P, 


For  R > 0,  — ^0,  and  one  need  only  consider  R > p,  (by  definition  of  p,),  in  which 
Pi 
R 


case  — >1.  In  both  cases  - V„. 

Pi 

submodular  functions  are  also  submodular,  we  find  that 


R R 

x\  1 + — v,  j\  is  submodular.  Since  mixtures  of 

Pi  Pi 


-I  P„  EV«-x 

\ R \ 

R 1 

x 1 - v.  / 

J 

11  P\ 

Pi  ] 

m 

I , 


2 
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is  submodular  on  the  sublattice  of  (4b).  By  Theorem  6.2  of  [13)  the  value  v„(x,  /)  that  optim- 
izes (4)  is  increasing  in  x.  This  completes  the  proof. 

We  note  that  if  the  optimizing  value  of  y is  not  unique,  then  consistently  choosing  either 
the  smallest  or  the  largest  such  value  will  guarantee  monotonicity. 

The  decision  variable  we  have  considered  so  far  is  y„(x,  /'),  the  amount  to  bet.  An  alter- 
native is  to  decide  how  much  not  to  bet.  An  example,  to  be  presented  below,  shows  that 
u„(x,  i)  - x - yn(x,  /')  is  not  monotone  in  x.  However,  in  the  same  spirit  of  Theorem  4.1  can 
establish  the  following  result. 

Let  R,  be  a random  variable  with  P[R,  > -1)  - 1.  Define  f , - |inf  {/■  > 0|  P[r  < 
Ri  < 0)|.  Then  we  have  € (0,  1]  or  f , - °°. 

THEOREM  4.2:  Assume  f , 6 (0,  1).  Then  x - f , y„(x,  i ) is  increasing  in  x. 

Proof:  If  we  make  the  change  u — x — y and  noting  that  we  need  not  consider  those 
values  R such  that  — < R <0,  the  proof  is  similar  to  that  of  Theorem  4.1. 


The  monotone  functions  of  x defined  above  are  tight,  in  the  sense  that  if  p,  > 0 (£,  < 1) 
and  p > p,(£  > {,),  then  there  exist  problems  for  which  x + pyn(x,  i ) [or  - £yn(x,  /)]  is  not 
increasing  in  x,  as  the  following  example  shows: 


Vlx]  - 


2x 

6 + jx, 


x < 4, 
4 < x. 


There  is  only  one  stage,  and  P[R  - U 


1 

2' 


Thus,  p,  - 1 and 


The  optimal  strategy  can  be  easily  computed 


y, .(*.  i) 


x. 

4 -x. 
2x  - 8, 
x. 


0 < x < 2, 

2 < x < 4, 

4 ^ x < 8, 

8 < x. 


For  p > 1 the  function  x + py ,(x,  /)  is  clearly  strictly  increasing  on  [0,2]  and  strictly 
decreasing  on  (2,4).  Similarly,  for  f > 1/2,  the  function  x — (yn(x,  /')  is  strictly  increasing  on 
[0,4]  and  strictly  decreasing  on  (4,8). 


It  is  also  interesting  to  note  that  the  above  results  do  not  depend  on  the  allowable  values 
of  x and  y.  Thus,  even  if  we  are  constrained  to  integer  fortunes  and  integer  wagers,  the  results 
will  still  hold,  since  they  are  based  on  the  isotonicity  results. 

The  combination  of  Theorems  4.1  and  4.2  yields 

COROLLARY  4.1:  Assume  p,  > 0 and  € (0,  1],  Then,  for  < > 0 


-f-  > yn(x  + t,  i ) - y„(x,  /')  > — 
»/  Pi 


\ 
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The  importance  of  this  result  lies  in  the  reduction  of  computational  effort:  If  the  solution  for  a 
fortune  x is  known,  we  can  bound  the  possible  optimal  wager  values  for  a player  with  fortune 

x + f. 


In  particular,  for  coin-tossing  games  (p  — ( - 1)  we  have 
COROLLARY  4.2:  For  coin-tossing  games 

(a)  x + y„  (x,  /')  is  increasing  in  x : "The  more  you  have  the  more  you  strive  for"; 

(b)  x — yn(x,  i)  is  increasing  in  x : "The  richer  you  are  the  more  you  save"; 

|.yn(x  + e,  <)  -^(x,  /)|  < «. 

From  Corollary  4.1  one  can  also  deduce  immediately 

COROLLARY  4.2:  Assume  p,  > 0,  f,  € (0,  1].  Then  y„(x,  i ) is  uniformly  continuous 


(c) 


in  x. 


EXTENSIONS  TO  MORE-GENERAL  STATE  SPACES 


All  of  the  preceding  results  can  easily  be  extended  to  more-general  state  spaces,  and,  in 
fact,  it  is  not  necessary  to  require  that  the  transition  rule  between  states  be  independent  of  the 
outcome  of  the  gamble.  However,  in  this  latter  situation,  Proposition  2.1  no  longer  holds,  as 
the  following  example  shows. 


The  first  game  is  a coin  toss  with  probability  0.4  of  winning.  Depending  on  whether  we 
win  or  lose  this  toss,  we  will  win  or  lose  all  successive  games.  The  utility  function  is  F(x)  — x 
One  can  easily  see  that,  for  n - 2,  the  optimal  strategy  is:  bet  x.  If  you  win,  bet  2x,  if  you 
lose,  bet  nothing.  Thus,  although  in  the  first  toss  the  probability  of  winning  is  0.4,  one  should 
wager  all  one’s  fortune. 
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SOME  SIMPLE  VICTORY-PREDICTION  CONDITIONS  FOR 
LANCHESTER-TYPE  COMBAT  BETWEEN  TWO  HOMOGENEOUS 
FORCES  WITH  SUPPORTING  FIRES* 


James  G.  Taylor 

Department  of  Operations  Research 
Naval  Postgraduate  School 
Monterey,  California 

ABSTRACT 

This  paper  develops  new  "simple"  victory-prediciion  conditions  for  a linear 
Lanchester-type  model  of  combat  between  two  homogeneous  forces  with  su- 
perimposed effects  of  supporting  fires  not  subject  to  attrition.  These  simple 
victory-prediction  conditions  involve  only  the  initial  conditions  of  battle  and 
certain  assumptions  about  the  nature  of  temporal  variations  in  the  attrition-rate 
coefficients.  They  are  developed  for  a fixed-force-ralio-breakpoini  battle  by 
studying  the  force-ratio  equation  for  the  linear  combat  model.  An  important 
consideration  is  shown  to  be  required  for  developing  such  simple  victory- 
prediction  conditions:  victory  is  not  guaranteed  in  a fixed-force-ratio- 
breakpoint  battle  even  when  the  force  ratio  is  always  changing  to  the  advantage 
of  one  of  the  combatants.  One  must  specify  additional  conditions  to  hold  for 
the  cumulative  fire  effectivenesses  of  the  primary  weapon  systems  in  order  to 
develop  correct  victory-prediction  conditions.  The  inadequacy  of  previous 
victory-prediction  results  is  explained  by  examining  (for  the  linear  combat 
model  without  the  supporting  fires)  new  "exact"  victory-prediction  conditions, 
which  show  that  even  the  range  of  possible  battle  outcomes  may  be 
significantly  different  for  variable-coefficient  and  constant-coefficients  models. 

1.  INTRODUCTION 

Even  though  combat  between  two  military  forces  is  a complex  random  process  (see  Note 
1 on  p.  65  of  Taylor  and  Brown  [21]),  as  a consequence  of  F.W.  Lanchester’s  [10]  pioneering 
1914  work,  from  about  the  end  of  World  War  11  military  operations  analysts  have  used 
simplified  deterministic  differential-equation  models  to  develop  insights  into  the  dynamics  of 
combat  [1-3,  25-27],  Today,  Lanchester-type  complex  system  models,  which  rely  on  modern 
digital-computer  technology  for  their  implementation  (see,  for  example.  Bonder  and  Honig 
[3]),  have  been  developed  for  various  levels  of  combat,  from  combat  between  battalion-sized 
units  [4]  to  theater-level  operations  [5,7]  ([20]  for  further  references).  Nevertheless,  a simple 
combat  model  may  yield  an  understanding  of  important  relations  that  are  difficult  to  perceive  in 
a more  complex  model,  and  such  insights  can  provide  valuable  guidance  for  higher-resolution 
computerized  investigations  (see  Bonder  and  Farrell  [2]  and  Weiss  [27]).  In  this  paper  we  will 
develop  new  victory-prediction  conditions  for  several  such  simplified  Lanchester-type  models  of 
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combat  between  two  homogeneous  forces  of  primary  weapon  systems  (such  as  infantry)  (271 
with  superimposed  effects  of  supporting  fires  [27]  not  subject  to  attrition  (see  Figure  1 of  Tay- 
lor and  Parry  [24])  in  order  to  obtain  some  insights  into  the  dynamics  of  combat  (among  oth- 
ers, the  tradeoff  between  quality  and  quantity  of  weapon  systems).  Such  results  are  not  only 
important  in  their  own  right  but  are  also  useful  in  the  quantitative  analysis  of  tactics  (see,  for 
example,  (13,  15)). 

It  is  important  for  the  military  operations  analyst  to  have  a clear  understanding  of  how 
force-level  and  weapon-system-performance  factors  interact  to  determine  the  outcome  of  battle. 
In  this  paper  we  show  that  there  are  two  types  of  battle-outcome-prediction  conditions,  "simple" 
ones  and  "exact"  ones.  In  his  well-known  survey  on  the  Lanchester  theory  of  combat,  Dolan- 
sky  [6]  suggested  the  development  of  outcome-predicting  relations  without  solving  in  detail  as 
one  of  several  problems  for  future  research.  The  work  at  hand  is  a step  towards  this  problem’s 
reslution  (see  also  Taylor  (16]  and  Taylor  and  Comstock  (231).  Furthermore,  work  by  Bonder 
and  Farrell  [2]  and  Taylor  [14,  21]  shows  that  in  general  the  analytical  solution  by  infinite  series 
to  variable-coefficient  Lanchester-type  equations  is  so  complicated  that  it  provides  by  itself  little 
information  about  battle  outcome.  We  show  that  a new  consideration  is  required  for  develop- 
ing simple  battle-outcome-prediption  conditions  from  the  force-ratio  equation.  We  then  use 
this  new  approach  to  develop  new  simple  victory-prediction  conditions  for  a linear  model  of 
Lanchester-type  combat  with  supporting  fires.  These  results  extend  earlier  work  by  Bach, 
Dolansky,  and  Stubbs  [1]  and  Taylor  and  Parry  [24].  Bach  et  al.  [1]  considered  the  constant- 
coefficient  version  of  the  linear  model  considered  here.  In  [24]  we  studied  the  Riccati  equation 
satisfied  by  the  force  ratio  for  this  model  with  variable  coefficients.  One  of  our  major  results 
was  the  development  of  conditions  on  the  battle’s  initial  state  that  we  thought  were  sufficient  to 
guarantee  victory  in  a fixed-force-ratio-breakpoint  battle. 

We  show  by  means  of  counterexample  that  our  earlier  approach  (24)  of  developing  condi- 
tions that  guarantee  that  the  force  ratio’s  rate  of  change  always  has  the  same  sign  (positive  or 
negative  but  never  zero)  is  inadequate  to  determine  correct  victory-prediction  conditions.  We 
then  develop  new,  simple  victory-prediction  conditions  for  the  linear  model  by  showing  that  a 
fixed-force-ratio  "breakpoint"  is  actually  reached  by  the  course  of  battle.  These  results  are  par- 
ticularly significant  (16,17,24)  because  they  show  that  developing  victory-prediction  conditions 
from  the  force-ratio  equation  is  much  more  difficult  than  we  had  initially  thought  (especially  for 
time-dependent  attrition-rate  coefficients).  By  examining  new  "exact"  force-annihilation- 
prediction  conditions  for  the  variable-coefficient  linear  model  without  supporting  fires,  we  show 
that  even  the  range  of  battle  outcomes  may  be  different  for  constant-coefficient  and  variable- 
coefficient  models:  there  is  a range  of  values  for  the  initial  force  ratio  (i.e.  more  than  a single 

value)  such  that  neither  side  will  ever  be  annihilated  if  and  only  if  (he  cumulative  fire 

effectiveness  of  each  side’s  weapon  system  is  bounded.  Finally,  the  significance  of  the  model 
with  supporting  fires  for  understanding  the  dynamics  of  combat  is  discussed. 

2.  COMBAT  MODELED  BY  VARIABLE-COEFFICIENT  LANCHESTER-TYPE 
EQUATIONS  OF  MODERN  WARFARE  WITH  SUPPORTING  FIRES 

We  consider  the  following  Lanchester-type  equations  with  (nonnegative)  time-dependent 
attrition-rate  coefficients: 

{dx/dt  — - a(t)y  - /3(r)x,  with  x(0)  — x0, 

dy/dt  - - 6(/)x  - a(t)y,  with  y(0)  - y0> 

The  equations  (1)  are  valid  only  for  x,y  > 0.  The  first,  for  example,  becomes  dx/dt  = 0 for 
x = 0.  Two  situations  that  have  been  hypothesized  to  yield  the  above  equations  are  (a) 
"aimed-fire"  combat  between  two  homogeneous  forces  with  "operational"  losses  (1)  and  (b) 
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"aimeri-fire"  combat  between  two  homogeneous  (primary)  forces  with  superimposed  effects  of 
supporting  fires  not  subject  to  attrition  (24}  (see  Figure  1).  The  prediction  of  the  attrition-rate 
coefficients  from  weapon-system  performance  data  is  discussed  in  [2]  (see  also  [24];  further 
references  are  given  in  [20]).  The  model  is  further  discussed  in  Taylor  and  Parry  [24], 


a(t) 


Taylor  and  Parry  [24]  noted  that  the  force  ratio,  u — x/y,  satisfies  the  Riccati  equation 

(2)  du/dt  - bit)u 2 + [a(f)  - /3(f)]u  - ait),  with  w(0)  - u0  * x0/y0, 

and  used  this  fact  »o  develop  much  useful  information  about  the  behavior  and  implications  of 
the  model  (1).  Before  proceeding  further  with  analysis,  we  must  specify  battle-termination 
conditions  for  our  model. 

As  Weiss  [25]  has  emphasized,  engagements  that  continue  until  one  side  is  wiped  out  are 
rare.  Although  we  are  well  aware  that  battle  termination  is  a complex  random  process  for 
which  it  is  by  no  means  certain  that  force  levels  are  the  only  significant  variables,  we  assume 
that  combat  ends  when  either  of  the  two  given  breakpoint  force  ratios  is  reached.  As  pointed 
out  by  Taylor  and  Parry  [24],  the  entire  subject  of  modeling  battle  termination  is  a problem  are 
in  contemporary  defense-planning  studies.  There  is  far  from  universal  agreement  on  this  topic 
(see  Taylor  [13]  for  further  references).  These  breakpoint  force  ratios,  denotes  as  u{  when  X 
wins  and  u{  when  Y wins,  satisfy  0 ^ u{  < u0  < < +^.  See,  for  instance,  Farrell  and 

Freedman  [8]  for  an  example  of  the  use  of  such  battle-termination  conditions  in  contemporary 
defense  analysis.  Corresponding  to  a fight  to  the  finish,  i.e.  a battle  until  the  annihilation  of 
one  side  or  the  other,  is  the  case  in  which  u{  «=  0 and  u{  = + °°. 

From  the  force-ratio  equation  (2)  Taylor  and  Parry  [24]  developed  a "local"  condition  of 
force  superiority,  e.g.  " Y is  winning"  when 

(3)  bit)  x2it)  + Mr)  - /3(f)]  xit)  yit)  < ait)  y2it), 

and  they  sought  to  develop  "global"  conditions  for  winning  a fixed-force-ratio-breakpoint  battle 
(i.e.  conditions  sufficient  to  guarantee  victory)  by  suitably  strengthening  hypotheses.  Unfor- 
tunately, there  was  a flaw  of  a rather  fundamental  nature  in  our  arguments  [24]  (and  also  sub- 
sequent ones  [16]),  as  the  counterexample  given  in  the  next  section  shows.  Furthermore,  sub- 
sequent research  has  shown  that  even  the  range  of  possible  battle  outcomes  may  be  significantly 
different  for  models  with  variable  (i.e.  time-dependent)  attrition-rate  coefficients  and  those 
with  constant  ones  (see  Section  5).  Thus,  our  difficulties  were  of  a fundamental  nature  that 
one  will  encounter  in  general  for  variable-coefficient  Lanchester-type  combat  models 
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Thus,  the  purpose  of  this  paper  is  to  give  a new  consideration  that  is  required,  in  general, 
for  victory  prediction  developed  via  the  force-ratio  equation  and  to  use  this  new  theoretical 
framework  to  develop  correct  victory-prediction  conditions  for  the  model  (1).  To  this  end,  let 
«+0)  and  «_(f)  denote  the  roots  of  b(r)u2  + (a(f)  - 0(f)]u  - alt)  - 0.  It  follows  that,  for 
b(t ) > 0, 

(4)  u±U)  - Jj8(f)  - alt)  ± V[0(f)  — a (/)]*  + 0)6 (r)|/(26(/)l, 

so  that  «_(/)  < 0 < u+((),  for  ait),  6(f)  > 0,  and  (see  Figure  2 of  I24J) 

j>  0,  for  u > u+(f), 
du/dt  0 for  „_(/)  < u (l) 

Taylor  and  Parry  [24]  proved  the  following  proposition. 

THEOREM  1:  If  du/dt(0)  < 0 and  u+(t)  is  a nondecreasing  Junction  of  time,  then  du/dtU) 

< 0 for  all  t > 0. 


It  is  therefore  of  interest  to  know  when  u+(t)  will  be  nondecreasing.  Let 

(6)  RU)  - a(f)/6(f),  and  S(f)  - [0(f)  - «(/)]  ^T)b(t), 

where  R(f)  represents  the  relative  fire  effectiveness  (T  to  X)  of  the  primary  units,  and  S(t) 
represents  the  net  effectiveness  of  Ks  supporting  units,  normalized  by  the  "intensity"  of  combat 
between  the  primary  units.  Observing  that  «+(/)  - y/RVJ  |[S(f  )/2]  + V[S(r)/2]J  + 1 },  Taylor 
and  Parry  [24]  also  proved 

THEOREM  2:  If  RU)  and  SU)  are  both  nondecreasing  functions  of  time,  then  «+(f)  is  non- 
decreasing function  of  time. 

However,  the  author  incorrectly  concluded  [24]  that  the  hypotheses  of  Theorem  1,  i.e., 
du/dtIO)  < 0 and  w+(f)  being  nondecreasing,  were  sufficient  to  guarantee  victory  for  Y.  The 
following  counterexample,  moreover,  shows  that  these  conditions  only  guarantee  that  T cannot 
lose,  not  that  he  will  win. 


3.  AN  INSTRUCTIVE  COUNTEREXAMPLE 

In  this  section  we  give  a counterexample  which  shows  that  du/dt(0)  < 0 and  w+(f)  non- 
decreasing  are  not  sufficient  to  guarantee  victory  for  Y in  a fixed-force-ratio-breakpoint  battle. 
We  consider  the  case  in  which  the  supporting  fires  are  absent  and  the  relative  fire  effectiveness 
of  the  primary  weapon  systems  is  constant,  i.e.,  aU)  - 0(f)  - 0,  for  all  f > 0,  o(f)  - k„hU), 
and  bit)  - kbhU).  Then,  as  observed  by  Farrell  [2],  Taylor  [12],  and  others  (see  Section  3 of 
Taylor  and  Brown  [21]), 

x(f)  — x0  cos/j  0(f)  - j'o-v/x^  sin/f  0(f), 
where  - ka/kb  and  0(f)  - -Jkakh  Jq  h(s)ds. 

We  now  show  that  xJyQ  < yfkg  does  not  always  imply  that  the  X force  will  be  annihi- 
lated if  lim  0(f)  - M < + oo.  For  example,  consider  a fire  fight  in  which  the  combatants  take 

/— *+oo 

"r  ;i 
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"aimed-fire"  combat  between  two  homogeneous  (primary)  forces  with  superimposed  effects  of 
supporting  fires  not  subject  to  attrition  [24]  (see  Figure  1).  The  prediction  of  the  attrition-rate 
coefficients  from  weapon-system  performance  data  is  discussed  in  [2]  (see  also  [24];  further 
references  are  given  in  [20]).  The  model  is  further  discussed  in  Taylor  and  Parry  [24], 


o(t) 


Figure  1.  Combat  between  two  homogeneous  forces  (infantry)  with  supporting  weapons 
(artillery)  not  subject  to  attrition. 


Taylor  and  Parry  [24]  noted  that  the  force  ratio,  u — x/y,  satisfies  the  Riccati  equation 

(2)  du/dt  - b(l)u2  + [a(l)  - /3(/)]u  - a(l),  with  u(0)  - u0  “ x0/y0, 

and  used  this  fact  to  develop  much  useful  information  about  the  behavior  and  implications  of 
the  model  (1).  Before  proceeding  further  with  analysis,  we  must  specify  battle-termination 
conditions  for  our  model. 

As  Weiss  [25]  has  emphasized,  engagements  that  continue  until  one  side  is  wiped  out  are 
rare.  Although  we  are  well  aware  that  battle  termination  is  a complex  random  process  for 
which  it  is  by  no  means  certain  that  force  levels  are  the  only  significant  variables,  we  assume 
that  combat  ends  when  either  of  the  two  given  breakpoint  force  ratios  is  reached.  As  pointed 
out  by  Taylor  and  Parry  [24],  the  entire  subject  of  modeling  battle  termination  is  a problem  are 
in  contemporary  defense-planning  studies.  There  is  far  from  universal  agreement  on  this  topic 
(see  Taylor  [13]  for  further  references).  These  breakpoint  force  ratios,  denotes  as  u{  when  X 
wins  and  u{  when  Y wins,  satisfy  0 < u{  < «0  < u{  < +oo.  See,  for  instance,  Farrell  and 
Freedman  [8]  for  an  example  of  the  use  of  such  battle-termination  conditions  in  contemporary 
defense  analysis.  Corresponding  to  a fight  to  the  finish,  i.e.  a battle  until  the  annihilation  of 
one  side  or  the  other,  is  the  case  in  which  u{  — 0 and  u{  — 4-  «>. 

From  the  force-ratio  equation  (2)  Taylor  and  Parry  [24]  developed  a "local"  condition  of 
force  superiority,  e.g.  " Y is  winning”  when 

(3)  b(t)  xHl ) + [«(/)  - p(l))  x(l)  y(t ) < ail)  y'it). 

and  they  sought  to  develop  "global"  conditions  for  winning  a fixed-force-ratio-breakpoint  battle 
(i.e.  conditions  sufficient  to  guarantee  victory)  by  suitably  strengthening  hypotheses.  Unfor- 
tunately, there  was  a flaw  of  a rather  fundamental  nature  in  our  arguments  [24]  (and  also  sub- 
sequent ones  [16]),  as  the  counterexample  given  in  the  next  section  shows.  Furthermore,  sub- 
sequent research  has  shown  that  even  the  range  of  possible  battle  outcomes  may  be  significantly 
different  for  models  with  variable  (i.e.  time-dependent)  attrition-rate  coefficients  and  those 
with  constant  ones  (see  Section  S).  Thus,  our  difficulties  were  of  a fundamental  nature  that 
one  will  encounter  in  general  for  variable-coefficient  Lanchester-type  combat  models. 
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cover  and  continue  to  reduce  their  vulnerability,  so  that  the  fire  effectiveness  decays  cxponcn- 
tially  over  time;  i.e.,  a(t)  - kae~y\  and  bit)  - kbe~y'.  For  this  example,  M ■■  yjk„kb/y.  Con- 
sequently, even  when  < y/\J,  we  can  always  choose  y so  that  lim  xO)  — x0 

cosh  M sin//  M > 0.  We  observe  that  R(t)  (-  ait)/bit)  - A»)  and  SO)  (- 0) 

are  both  nonincreasing  (so  that  w+0)  is  nonincreasing),  but  yet  xo/y0  < >/X#  does  not  imply 
that  X will  be  annihilated  or  even  lose  a fixed-force-ratio-breakpoint  battle.  The  latter  follows, 
since 

lim  uO)  - Vx7  Kw0  + >/x7)e_2W+  u0  - -s/x^l/Kw,,  + y/k^)e~2M~  (w0  - >/x7)l 

can  be  made  to  take  on  any  value  betwen  0 and  u0  by  the  appropriate  choice  of  M (through  our 
choice  of  y). 

Thus,  this  counterexample  shows  that  RO)  and  SO)  nonincreasing  so  that  u+0)  is 
nonincreasing)  and  du/dt(0)  < 0 only  imply  that  du/dtO)  < 0 for  all  t > 0.  These  conditions 
do  not  imply  that  X will  lose  a fixed-force-ratio-breakpoint  battle  in  finite  time.  However,  for 
this  example  if  we  additionally  assume  that  lim  90)  - + then  X must  lose  the  battle.  In 

/— +0 O 

the  next  section  we  show  how  this  additional  assumption  is  extended  to  the  general  model  (1) 
to  yield  conditions  that  are  sufficient  to  guarantee  an  X loss. 

4.  SIMPLE  VICTORY-PREDICTION  CONDITIONS  FOR  A 
FIXED-FORCE-RATIO-BREAKPOINT  BATTLE 

XT 

bO)dt 

exists  (and  is  given  by  a finite  quantity).  We  assume  that,  for  / > 0,  aO)  and  bO)  are  con- 
tinuous, except  for  a finite  number  of  points  in  time.  It  follows  that  bO)  4 Li 0,+°°)  means 

that  lim  f bO)dt  - + «>.  We  then  have 
r— +«  Jo 

THEOREM  3:  Assume  that  (Al)  R it)  and  SO)  are  nondecreasing  Junctions  of  time,  (A2) 
bit)  4 Li 0,  + °°),  and  (A3)  R it)  is  not  identically  equal  to  zero.  If  b^x^  + a^XoVo  < 
a ay 2 + PoXaya,  then  X will  lose  any  Jixed-force-ratio-breakpoint  battle  in  finite  time. 

PROOF:  We  denote  a(0)  as  a0,  etc.  Then  R It)  and  SO)  nondecreasing  implies  that 
u+(t)  is  nondecreasing  by  Theorem  2.  The  initial-condition  inequality  b0  xj  + a0  x0  yo  < 
a0  yo  + Po  *oy<>  implies  that  du/dti 0)  < 0,  so  that  Theorem  1 tells  us  that  du/dtlt)  < 0 for 
all  t ^ 0.  It  remains  to  show  that  u(t)  y u{  < u0  in  finite  time.  The  latter  result  may  be  pro- 
ven by  showing  that  uO)  < u0  - f bis)ds,  where  K\  > 0,  since  lim  f ' b(s)ds  - + oo. 

There  are  now  two  cases  to  be  considered:  (Cl)  SO)  < 0 for  all  t > 0,  and  (C2)  there  exists 
1 1 > 0 such  that  RO,)  > 0 and  Sit |)  > 0. 

CASE  (Cl):  SO)  < 0 for  all  t > 0.  We  observe  that  it  is  impossible  to  have  o0  — 0. 
Hence,  RO)  >0  for  all  / >0  and  du/dt  - bit)Rit)  [u2/R  0)  + l-SO)/R],1(t)]u  - 1) 
Hbit)R0{u2/RO)  + t-S0)/R,/20)]«-l)  < bit) Rq(uq  /Ro  + [-So/R^/2l«0  “ D - 
lbit)/b0]du/dtiO).  The  first  inequality  follows  from  RO)  being  nonincreasing  and  du/dt  it)  < 
0 for  all  t > 0,  while  the  second  follows  from  R it)  and  SO)  being  nondecreasing  and  uit) 
nonincreasing.  It  follows  that  uit)  < u0  + il/b0) du/dt  10)  bls)ds,  and  the  theorem  is  pro- 
ven in  this  case. 

CASE  (C2):  There  exists  1 , > 0 such  that  RO,)  > 0 and  Sit\)  > 0.  We  begin  by 
observing  that  uit)  < u0  + X,  (du/dt)dt  for  f > f,  > 0.  The  minimum  of  du/dt  considered 


[ 
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as  a function  of  u occurs  at  «*(/)  = Rl/ 2 (/)  S(r)/ 2.  Consequently,  for  t > rt  we  then  have 
du/dtO.u—  0)  < du/dtO.u)  < du/dtO.u*)  for  0 < « < w*,  where  du/dtO.u)  denotes  that  we 
are  considering  du/dt  to  depend  on  the  two  indicated  variables.  Thus,  for  t > t\  > 0 and  0 < 
u < R[,1(t)  SO)/ 2,  we  have  du/dtO)  K - aO ) < -b(t)  /iff]).  Also,  for  / > f|  < 0 and  0 
< RU10)  SO)/2  ^ u < u+0),  we  have  du/dt  - 6(r)  /? (/)  {(w//? ,/2(/)  — S(r)/2]2  — 
[1  + (S(r)/2)J)|  < bO)  /?(/,)  {[«//? ,/2(/)  - S(r)/2]J  - [1  + (S(r)/2)2]}  < bO ) RO\) 
[[uO\)/R'n  (/|)  - SO |)/2]7  - [1  + (S(f,)/2)2])  - I*(/)/*(/|>]</«M(/,).  The  first  inequality 
on  du/dt  follows  from  WO)  being  nondecreasing  and  du/dt  < 0.  The  second  follows  from 
RO)  and  SO)  being  nondecreasing,  u 0)  nonincreasing,  and  the  fact  that  0 < w0)/W,/20)  - 
S(t)/2.  Thus,  we  have  shown  that,  for  t > t\  > 0, 

j-M/)  WO,),  for  0 < w < R'nO)SO)/2, 

du/dtOX  {[-\/b(, x)]du/dt 0,)},  forO  < Rl/10)SO)/2  < u < u+O). 

It  follows  that  u(r)  < u0- K\  b(s)ds,  where  K)  — minimum  l/?0|), 

[—\/b0 /)]du/dtO\)\  > 0,  and  the  theorem  is  proven  in  the  second  case.  Q.E.D. 

COMMENT  1:  The  victory-prediction  inequality  in  Theorem  3 may  be  written  as 
Wo  < jRl  I(50  + -JSj2)7-¥  1].  Thus,  instead  of  the  six  absolute  quantities  (i.e.,  two  force 
levels  and  four  attrition-rate  coefficients),  there  are  only  three  independent  relative-capability 
parameters  (one  relative-primary-force-size  parameter  and  two  relative-fire-effectiveness  param- 
eters) involved  in  victory  prediction:  (1)  the  initial  force  ratio  of  primary  systems,  (2)  the  ini- 
tial relative  fire  effectiveness  of  the  primary  weapon  systems,  and  (3)  the  initial  net  fire 
effectiveness  of  the  supporting  weapons  normalized  by  the  intensity  of  combat  between  the  pri- 
mary weapon  systems. 

COMMENT  2:  As  we  pointed  out  previously  [23,241,  when  the  supporting  fires  are 
always  equally  effective  (i.e.  aO)  - RO)),  their  effects  "cancel  out,"  and,  in  terms  of  the  force 
ratio,  the  battle's  outcome  (although  accelerated)  is  the  same  as  though  they  were  not  present. 

COMMENT  3:  Let  us  introduce  the  "elapsed  normalized  battle  time"  (for  combat 
between  the  primary  weapon  system)  t-tq,  which  is  defined  by 

(7)  r — r0  = 'Ja  (t)b(t)  t = y/a  (s)b(s)  ds  , 

where  y/a(t)b(t)  - (l/t)  i:  y/a(s)b(s)  ds  denotes  the  average  intensity  of  combat  between 
the  primary  weapon  systems.  Then  the  assumptions  that  RO)  is  nondecreasing, 
b(t)4  Z,(0,  + °°),  and  RO)  is  not  identically  equal  to  zero  yield  that  the  elapsed  normalized 
battle  time  (for  combat  between  the  primary  weapon  systems)  grows  without  bound  (i.e. 
t-t0— * + oo  as  t— > + <»).  The  elapsed-normalized-battle-time  parameter  — J y/a(s)b(s)  ds 
was  introduced  by  Taylor  and  Brown  [22]  in  their  study  of  variable-coefficient  Lanchester-type 
equations  of  modern  warefare  (8).  Its  introduction  sometimes  significantly  reduces  the  com- 
plexity of  analytical  results  (see  [22]). 

In  Theorem  3 the  assumptions  that  (A2)  b(r)  4 L(0,  +<»)  and  (A3)  RO)  is  not  identi- 
cally equal  to  zero  insure  that  the  battle  will  terminated  in  finite  time.  They  mean  physically 
that  Y’s  fire  effectiveness  against  X does  not  decay  "too  rapidly"  over  time,  so  that  not  only  is 
the  course  of  battle  always  moving  toward  a Y victory  but,  also,  that  victory  is  actually  reached. 
We  conjecture  that,  for  such  combat  between  two  homogeneous  forces,  conditions  such  as 
(A2)  and  (A3)  on  the  primary-weapon-system  attrition-rate  coefficients  are  always  necessary  to 
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insure  that  the  battle  will  terminate  in  finite  time.  We  observe  that  (A2)  is  automatically 
satisfied  for  constant  attrition-rate  coefficients.  Moreover,  for  a fight  to  the  finish  with  support- 
ing fires  absent,  we  know  that  the  conjecture  is  true,  as  results  in  the  next  section  show. 

5.  EXACT  FORCE-ANNIHILATION-PREDICTION  CONDITIONS  FOR  VARIABLE- 
COEFFICIENT  LANCHESTER-TYPE  EQUATIONS  OF  MODERN  WARFARE 

In  this  section  we  give  results  (see  Theorem  4 below)  that  show  how  battle  termination 
(i.e.,  the  combat’s  reaching  of  the  battle-termination  conditions)  is  related  to  the  boundedness 
of  the  primary  systems’  cumulative  fire  effectivenesses.  Let  us  observe  that  (for  the  assump- 
tions made  below)  a firer’s  (for  example,  an  X unit’s)  cumulative  fire  effectiveness  being 
bounded  is  equivalent  to  the  integrability  of  his  attrition-rate  coefficient  over  the  interval 
10,  +°o)  (e.g.,  bit)  € L (0.  +«>)).  For  a fight  to  the  finish  and  Lanchester-type  equations  of 
modern  warfare,  with  the  supporting  fires  absent  (i.e.  ait ) - p (/)  - 0 for  all  t >0),  we  show 
that  if  each  primary  system's  cumulative  fire  effectiveness  remains  bounded,  i.e.,  air)  and 
bit)  € Li 0, +oo),  then  neither  side  need  ever  be  annihilated.  (It  follows  by  the  Cauchy- 

Schwarz  inequality  for  integrals  that  ait)  and  Hr)  € LiO,  +<»)  implies  that  lim  f 

y/a(s)bis)  ds  < + oo.  Thus,  the  elapsed  normalized  battle  time  t-t0,  as  given  by  (7), 
remains  bounded.)  This  result  explains  what  happened  in  the  counterexample  given  in  Section 
3.  Although  Theorem  4 may  be  simply  stated,  its  proof  is  fairly  lengthy  [18]  and  will  not  be 
included  in  this  paper.  Moreover,  it  is  not  developed  from  the  force-ratio  equation  (2). 


Accordingly,  we  consider  combat  modelled  by 
dx/dt—-ait)y  and 


dy/dt  - -bit)x , 


where  the  battle  begins  at  r- 0,  and  we  assume  that  ait ) and  Hr)  are  defined,  positive,  and 
continuous  for  r0  < r < + oo,  with  r0  < 0.  We  also  assume  that  ait),bit)  € Lit0,T)  for  any 
finite  T.  W'e  further  take  the  attrition-rate  coefficients  a(r)  and  Hr)  to  be  given  in  the  form 


ait)  - kag(t) 


kbhit) , 


where  ka  and  kh  are  positive  constants.  In  other  words,  we  assume  that  previous  analysis  has 
determined  the  attrition-rate  coefficients  to  be  of  the  above  form  (9).  This  general  form  has 
been  suggested  by  the  various  specific  attrition-rate  functional  forms  that  have  appeared  in  the 
literature  (e.g.,  see  (14,  19,  21,  23]),  and  all  the  attrition-rate-coefficient  examples  known  to 
this  author  are  of  this  form.  The  reader  is  directed  to  Taylor  (19]  for  a discussion  of  how  the 
parameters  ka  and  kh  may  in  turn  be  related  to  weapon-system-capability  and  engagement- 
characteristics  parameters. 

We  observe  that  ait)/bit)  - kjkb  in  the  special  case  in  which  git)  = hit).  In  other 
words,  k„  and  kh  are  basically  "scale  factors"  which  are  useful  for  the  parametric  study  of  battle 
outcomes.  Motivated  by  the  form  of  well-known  constant-coefficient  results  (e.g.  see  [23]),  we 
introduce  the  combat-intensity  parameter  X,  and  the  relative-fire-effectiveness  parameter  X* 
defined  by 

(10)  X,  - y/kakh  and  kK-kJkh. 

From  our  assumptions  about  ait ) and  bit),  it  follows  that  a(r)  i L(0,  +»)  means  that 

lim  f a(s)ds  -+  oo. 

/-+»  Jo 


We  introduce  the  following  hyperbolic-like  general  Lanchester  functions  [21,  22]  (GLF) 
Cx(t)  and  Sx(t),  which  are  the  two  linearly  independent  solutions  to  the  X-force-level  equation 
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d2x/dl 1 - {[1  /a(t)]da/dt\dx/dt  - a(r)b(t)x -0  , 

with  initial  conditions 


(12) 


CxO  o>-l.  5^(/0)-0. 

Il/fl(to)J</Cj|f/^f (/o)  «■  0,  U/a(t0)]dSx/dt(to)  — 1/>AT  , 
where  f0  denotes  the  largest  finite  time  at  which  a(r)  or  b(i ) ceases  to  be  defined,  positive, 

AAlltiMIIMIB  U7&  a Air  ...  a...L  _ A I * *->  f . I _ a 


or 
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continuous.  We  set  /0-0  if  no  such  finite  time  exists.  Analogous  GLF  for  the  corresponding 
Y force-level  equations  are  similarly  defined. 


Let  F{Q ) — lCjr(O)  — Q5r(O)]/[0Cr(O)  - SV(0)].  Then  the  following  theorem  [18]  is 
an  extension  of  Taylor  and  Comstock’s  [23]  force-annihilation-prediction  results. 


THEOREM  4 (Taylor  [18]):  The  X force  will  be  annihilated  in  finite  time  if  and  only  if 
xo/yo  < >/*/»  F(Q*mxx).  Neither  side  will  be  annihilated  infinite  time  if  and  only  if 


VA ~rF(Q  *max)  ^ xjyo  ^ >Jh-R  F(Q* mjn)  , 


where 


lim  Sx(t)/CxU)  - l/(?*„ 

f— +00 


and 


lim  Sy(t)/Cy(t)  - Q\ 


We  always  have  Q*mm  < Q* mix.  Furthermore  Q*min  <Q*mxx  if  and  only  if  both  all)  and 
b(t)  € HO,  +oo). 


We  observe  that  for  to  • 0 we  have  F(Q)  — 1/Q.  Some  examples  of  the  analytical  deter- 
mination of  Q * - Q*mn  - O’min  are  given  in  the  paper  by  Taylor  and  Comstock  [23],  while 
examples  of  the  prediction  of  force  annihilation  are  given  in  Taylor  and  Brown  [22]. 


Theorem  4 explains  what  was  going  on  in  the  counterexample  given  in  Section  3.  For  a 
fight  to  the  finish,  we  find  that  du/dt(t ) < 0 for  all  / ^ 0 when  xjy0  < - y/kjkh. 

Since  Cx(t)  — Cy(t)~  cosh  00),  etc.,  it  follows  by  Theorem  4 that  neither  side  will  be  annihi- 
lated in  finite  time  for  VxJ  0 - e_J*0/(l  + e~lhi)  < x0/y0  < V*/?  0 + e'JM)  /(I  - e~J*0. 
Thus,  there  exist  initial  force  ratios  such  that  du/dt(t)  < 0 always  but  yet  X is  never  annihi- 
lated. Moreover,  Theorem  4 tells  us  that  this  can  happen  for  more  than  a single  value  of  xo/y0 
only  when  both  aO)  and  b(t)  € L(0,  + <»). 


6.  DISCUSSION 


Although  highly  idealized,  the  model  (1)  is  significant  because  of  the  insights  provided 
into  the  dynamics  of  combat.  We  may  consider  (1)  to  model  combat  between  two  homogene- 
ous forces  (primary  weapon  systems)  with  superimposed  effects  of  supporting  fires.  Lanchester 
[10]  apparently  believed  in  1914  that  the  modern  trend  in  warfare  was  toward  greater  concen- 
tration of  forces  (i.e.,  higher  troop  density)  and  formulated  his  now-classic  model  of  combat 
(without  supporting  fires)  in  order  to  quantitatively  justify  the  principle  of  concentration.  It  is 
significant  to  note  (see  [9])  that  the  actual  trend  in  combat  operations  over  the  past  two 
thousand  years  of  military  history  has  been  towards  greater  dispersion  of  forces  (i.e.,  lower 
troop  density).  Some  figures  for  the  last  hundred  years  are  shown  in  Table  I (see  Stewart  [11]). 
Furthermore,  the  model  (1)  may  be  used  to  gain  insights  into  whether  or  not  it  is  "beneficial" 
to  concentrate  forces,  i.e.,  whether  or  not  a side  should  make  its  initial  commitment  of  forces 
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TABLE  1.  Increase  in  the  Dispersion  of  Troops  from  the 
U.S.  Civil  War  to  World  War  II  (from  Stewart  (11]) 


Item 

Area  of  100,000  men 
(in  square  miles) 

Average  frontage  of 

100.00  men  (miles) 

Average  depth  of 

100.000  men  (miles 


Civil  War 
26.8 


World  War  I 

World  War  II 

140 

1727 

11 

38.4 

13 

45 

as  large  as  possible.  Results  show  that,  if  the  "intensity"  of  the  supporting-fire  combat  exceeds 
that  of  the  primary  systems  [i.e.,  a(/)/3(f)  > a (r)  6 (r )1,  then  the  victor  should  not  concentrate 
his  forces.  Actually,  additional  hypotheses  are  required.  For  simplicity,  we  have  omitted  them 
here.  (See  Taylor  [17]  for  a detailed  analysis  of  the  decision  to  concentrate  forces).  Consider- 
ing the  past  increases  [9]  in  the  fire  effectiveness  of  supporting  weapons  relative  to  those  for 
primary  weapon  systems  (e.g.,  small  arms),  we  would  expect  that,  in  general,  a(/)/9(r)  > 
a 0)60 ) on  the  modern  battlefield.  Consequently,  the  victor  should  not  concentrate  his 
forces,  according  to  the  above.  Thus,  the  model  (1)  yields  a theoretical  result  that  is  in  better 
agreement  with  the  historical  trend  in  military  operations  than  is  that  yielded  by  Lanchester's 
original  model  without  supporting  fires  (i.e.,  the  victor  should  aiways  concentrate  forces). 

A major  contribution  of  this  paper  has  been  to  show  that  in  the  development  of  victory- 
prediction  conditions  it  must  be  proven  that  the  battle-termination  conditions  will  be  actually 
reached.  The  counterexample  in  Section  3 showed  that  even  though  the  force  ratio  is  always 
becoming  more  favorable,  for  example,  to  Y,  this  condition  does  not  guarantee  that  Y will  win 
a fixed-force-ratio-breadpoint  battle.  This  fact  was  not  appreciated  by  us  in  our  earlier  work 
[24]  and  its  subsequent  extension  [16].  In  [16]  we  tried  to  develop  general  outcome-prediction 
conditions  based  on  a comparison  of  the  force  ratio  and  the  instantaneous  force-change  ratio 
(for  cases  of  no  replacements  and  withdrawals,  the  instantaneous  casualty-exchange  ratio). 
Unfortunately,  this  work  contains  the  same  type  of  flaw  as  that  of  Taylor  and  Parry  [24]  dis- 
cussed in  this  paper:  the  conditions  developed  are  sufficient  to  guarantee,  for  example,  that  the 
force  ratio  keeps  on  changing  in  Y’s  favor  but  not  that  he  will  win  a fixed-force-ratio-breakpoint 
battle  in  finite  time.  Thus,  the  development  of  battle-outcome-prediction  conditions  is  much 
more  difficult  for  combat  modelled  by  time-dependent  attrition-rate  coefficients  than  we  had 
earlier  thought.  However,  we  showed  that  some  of  our  earlier  incorrect  outcome-prediction 
results  (i.e.,  those  in  Taylor  and  Parry  [24])  could  be  corrected  by  the  incorporation  of  addi- 
tional simple  attrition-rate-coefficient  assumptions  that  yield  that  the  elapsed  normalized  battle 
time  (see  Comment  2 above)  grows  without  bound  and  consequently  guarantee  that  Y will 
actually  win.  Unfortunately,  our  general  outcome-prediction  results  involving  the  force  ratio 
and  the  instantaneous  force-change  ratio  [16])  cannot  be  so  easily  corrected. 

■ 1 

In  general,  outcome-prediction  conditions  provide  insights  into  the  tradeoff  between  qual- 
ity and  quantity  of  weapon  systems.  In  his  classic  paper  Lanchester  [10]  assumed  that  the  com- 
batants’ Are  effectivenesses  were  constant  over  time  and  deduced  his  famous  square  law,  which 
allows  one  to  trade  off  quality  versus  quantity  of  weapon  systems  by  means  of  the  condition  for 
equality  of  fighting  strengths,  x0/.y0  — yfajb,  where  a and  b denote  constant  attrition-rate 
coefficients.  In  this  paper  we  have  given  both  simple  and  exact  outcome-prediction  conditions 
which  provide  such  tradeoff  insights  for  Lanchester-type  combat  with  supporting  fires. 
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Our  simple  outcome-prediction  conditions  [see  Theorem  3,  which  only  involves  (a)  the 
initial  force  ratio  of  primary  systems,  (b)  the  initial  relative  fire  effectiveness  of  the  primary 
systems,  and  (c)  the  initial  net  fire  effectiveness  of  the  supporting  weapons  normalized  by  the 
intensity  of  combat  between  primary  systems  (see  Comment  1 above)]  are  rather  strong 
sufficient  conditions.  In  other  words,  X may  still  lose  when  they  are  not  satisfied.  On  the  other 
hand.  Theorem  4 gives  necessary  and  sufficient  conditions  for  force  annihilation  (and  also 
nonannihilation  of  both  sides).  We  have  accordingly  called  these  outcome-prediction  condi- 
tions exact.  So-called  higher  transcendental  functions  (e.g.,  GLF  such  as  the  LCS  [21,22]  func- 
tions), unfortunately,  may  be  involved  (e.g.,  for  t0  < 0 and  a(t)/b(t)  * constant)  in  these 
exact  force-annihilation-prediction  conditions.  By  contrasting  the  complexity  of  these  two  types 
of  conditions  (i.e.,  the  simple  and  the  exact),  we  see  the  price  in  mathematical  complexity  that 
one  has  to  pay  for  greater  accuracy  in  outcome  prediction. 
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